00000001:02000400:3.0F:1783951375.135709:0:2968:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_hostid 00000001:02000400:3.0:1783951397.053459:0:3188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1783951399.239781:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 403 MB/s 00000001:01000000:3.0:1783951399.493051:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 515 MB/s 00000001:01000000:0.0:1783951399.746167:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3814 MB/s 00000020:02000000:0.0:1783951400.577653:0:3281:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_gb5ded84 00000400:02000000:3.0:1783951401.669353:0:3296:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.201.106@tcp [8/256/0/180] 00008000:02000000:2.0F:1783951405.058526:0:3445:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1783951464.619252:0:5247:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783951471.752248:0:5772:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783951471.752255:0:5772:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1783951471.752387:0:5772:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000ad22fe79 00000080:02000400:2.0:1783951471.752400:0:5772:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1783951471.757105:0:5772:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1783951471.757120:0:5772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783951471.757160:0:5772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008c49a595) 00000020:00000080:2.0:1783951471.757180:0:5772:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783951471.778963:0:5772:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1783951471.779380:0:5772:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783951471.820983:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783951471.821138:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783951471.821158:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783951471.821349:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783951471.821379:0:5772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783951471.822057:0:5772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783951471.822066:0:5772:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783951471.822077:0:5772:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eec05e 00000020:01000004:2.0:1783951471.822086:0:5772:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783951471.822091:0:5772:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783951471.822096:0:5772:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ad22fe79 from MGS 00000020:01000004:2.0:1783951471.822100:0:5772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783951471.822110:0:5772:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b956850f) 00000020:00000080:2.0:1783951471.822120:0:5772:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783951471.822183:0:5772:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad22fe79 from MGS, refs=2 00080000:01000000:2.0:1783951471.822187:0:5772:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783951471.822193:0:5772:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eec06c 00000100:00100000:2.0:1783951471.822309:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783951471.822433:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783951471.822439:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783951471.823677:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783951471.823692:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783951471.831094:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951471.832165:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783951471.832174:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783951471.836329:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783951471.836342:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783951471.836896:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783951471.836903:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783951471.837928:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951471.837932:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951471.837934:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951471.839054:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951471.839057:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951471.839059:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951471.839897:0:5772:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783951471.841874:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0F:1783951472.090896:0:5772:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2721 MB/s 00000001:01000000:2.0:1783951472.345495:0:5772:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2826 MB/s 00000001:01000000:0.0:1783951472.596103:0:5772:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 509 MB/s 00000001:01000000:3.0:1783951472.847407:0:5772:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 784 MB/s 00080000:10000000:3.0:1783951472.855197:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1783951472.871589:0:5772:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783951472.871609:0:5772:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783951472.871612:0:5772:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1783951472.875261:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783951472.878467:0:5772:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783951472.878529:0:5772:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783951472.878756:0:5772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783951472.878784:0:5772:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783951472.885633:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951472.885864:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783951472.885872:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:0.0:1783951472.886074:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951472.887377:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783951472.887393:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783951472.887776:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783951472.887783:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783951472.891011:0:5772:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783951472.891035:0:5772:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.106@tcp' 00000020:01000004:2.0:1783951472.891037:0:5772:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783951472.891098:0:5772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.106@tcp (typ=mgc) 00000020:00000080:2.0:1783951472.891111:0:5772:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.106@tcp (000000004bcb2654) 00000020:00000080:2.0:1783951472.891129:0:5772:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783951472.891227:0:5772:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000064754439@MGC192.168.201.106@tcp: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1783951472.891438:0:5772:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.106@tcp-0 is initialized 00000040:01000000:2.0:1783951472.891445:0:5772:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 1 is initialized 10000000:01000000:2.0:1783951472.891657:0:5788:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783951472.891678:0:5772:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.106@tcp (uuid 8da93b96-3ed4-473a-afe6-6e7d7d0f924f) 00000020:00000080:2.0:1783951472.891692:0:5772:0:(genops.c:1406:class_connect()) connect: client 8da93b96-3ed4-473a-afe6-6e7d7d0f924f, cookie 0x443dabd358eec07a 00000100:00080000:2.0:1783951472.891702:0:5772:0:(import.c:510:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951472.891706:0:5772:0:(import.c:624:import_select_connection()) MGC192.168.201.106@tcp: import 0000000064754439 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951472.891747:0:5772:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009d4d527f x1870608624255104/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951472.891772:0:5772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS 00000020:01000004:2.0:1783951472.891790:0:5772:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783951472.891794:0:5772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783951472.891803:0:5772:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000335c67fc) 00000020:00000080:2.0:1783951472.891833:0:5772:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783951472.895076:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d4d527f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3311:1870608624255104:0@lo:250: 00000100:00100000:3.0:1783951472.895523:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783951472.895673:0:5787:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1783951472.901016:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624255104 00000100:00100000:0.0:1783951472.901030:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624255104 00000100:00100000:0.0:1783951472.901079:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951472.901085:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b85eb380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1870608624255104:12345-0@lo:250: 00010000:00080000:0.0:1783951472.901122:0:5784:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8da93b96-3ed4-473a-afe6-6e7d7d0f924f@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1783951472.901148:0:5784:0:(genops.c:1406:class_connect()) connect: client 8da93b96-3ed4-473a-afe6-6e7d7d0f924f, cookie 0x443dabd358eec088 00000100:00080000:0.0:1783951472.901298:0:5784:0:(import.c:65:import_set_state_nolock()) 00000000e2d8da0e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951472.901394:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b85eb380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:3311:x1870608624255104:12345-0@lo:250: Request processed in 308us (6204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951472.901402:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951472.903624:0:3311:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783951472.903644:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.106@tcp: connect to target with instance 0 00000100:00080000:3.0:1783951472.903653:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783951472.903659:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783951472.903663:0:3311:0:(import.c:65:import_set_state_nolock()) 0000000064754439 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783951472.903667:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783951472.903671:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783951472.903679:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d4d527f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3311:1870608624255104:0@lo:250: 00000100:00100000:2.0:1783951472.904224:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951472.904508:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783951472.904516:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783951472.905284:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783951472.905339:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783951472.909040:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783951472.909051:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1783951472.910076:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951472.910266:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1783951472.910271:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783951472.910769:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783951472.910775:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783951472.937207:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951472.937456:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783951472.937481:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783951472.938585:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783951472.938593:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783951472.939405:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951472.939570:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783951472.939575:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783951472.940125:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783951472.940131:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783951472.941790:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951472.942147:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783951472.942153:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783951472.942651:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783951472.942657:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783951472.943273:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951472.943407:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783951472.943412:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783951472.944051:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783951472.944057:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783951472.981441:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951472.981739:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783951472.981746:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783951472.984212:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783951472.984227:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783951472.985284:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783951472.985294:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783951472.987248:0:5772:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783951472.987280:0:5772:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783951472.987287:0:5772:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783951472.987453:0:5772:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783951472.987494:0:5772:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783951472.987500:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783951472.987501:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951472.987503:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951472.987504:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951472.987505:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951472.987506:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951472.987508:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951472.987509:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951472.987510:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783951472.987511:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783951472.987513:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951472.987514:0:5772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783951472.987516:0:5772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783951472.987523:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783951472.987524:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951472.987525:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951472.987526:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951472.987527:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951472.987528:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951472.987528:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951472.987529:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951472.987530:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783951472.987531:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783951472.987531:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951472.987532:0:5772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783951472.987567:0:5772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783951472.987586:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dd3b3b45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255232:0@lo:253: 00000100:00100000:2.0:1783951472.987736:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951472.988123:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000007ee64e8d going to sleep for 11 seconds 00000100:00100000:1.0:1783951472.988252:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624255232 00000100:00100000:1.0:1783951472.988261:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624255232 00000100:00100000:1.0:1783951472.988356:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951472.988364:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b5e7098 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:5772:x1870608624255232:12345-0@lo:253: 20000000:01000000:1.0:1783951472.988409:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783951472.988413:0:5786:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1783951472.988757:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783951472.988850:0:5786:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1783951472.989378:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951472.991350:0:5808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1783951472.991727:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783951472.991732:0:5786:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1783951472.991739:0:5786:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1783951472.991742:0:5786:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1783951472.991762:0:5786:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1783951472.992518:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951472.992937:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1783951472.993025:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783951472.993077:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1783951472.993213:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1783951472.993253:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1783951472.993358:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1783951472.993367:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1783951472.993415:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1783951472.993424:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1783951472.993458:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1783951472.993466:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1783951472.993499:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1783951472.993553:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1783951472.993585:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783951472.993590:0:5786:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1783951472.993603:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951472.994066:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1783951472.994077:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783951472.994204:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1783951472.994257:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1783951472.994304:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1783951472.994315:0:5786:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1783951472.994391:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1783951472.994400:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783951472.994446:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1783951472.994482:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1783951472.994520:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1783951472.994531:0:5786:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1783951472.994613:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1783951472.994622:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1783951472.994654:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1783951472.994707:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1783951472.995349:0:5786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1783951472.995460:0:5786:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783951472.995469:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783951472.996573:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783951472.997272:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783951472.997303:0:5786:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.106@tcp for mdt 20000000:01000000:1.0:1783951472.997306:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:1.0:1783951472.997345:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783951472.997353:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783951472.997456:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783951472.997466:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:1.0:1783951472.997514:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783951472.997525:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783951472.997558:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783951472.997594:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783951472.997719:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783951472.997723:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783951472.997743:0:5786:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783951472.997750:0:5786:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1783951472.998447:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1783951472.998593:0:5786:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783951473.010666:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783951473.010764:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1783951473.010888:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1783951473.010908:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783951473.010911:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783951473.010915:0:5786:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783951473.010929:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783951473.010931:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783951473.010962:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783951473.010965:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783951473.017897:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1783951473.018602:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1783951473.018666:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1783951473.018749:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1783951473.018765:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783951473.018768:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783951473.019623:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1783951473.019853:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1783951473.019895:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1783951473.019916:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1783951473.019926:0:5786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783951473.019927:0:5786:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1783951473.019933:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783951473.019955:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.019974:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.019983:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.019989:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.020001:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.020007:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.020012:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9ed46c2 already unused, calling callback (00000000337e228e) 00010000:00010000:3.0:1783951473.020015:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.020020:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.020030:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.020036:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.020041:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9ed46c2/0x443dabd358eec08f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951473.020053:0:5786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783951473.191185:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b5e7098 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:5772:x1870608624255232:12345-0@lo:253: Request processed in 202804us (203433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.191202:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951473.191313:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dd3b3b45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255232:0@lo:253: 10000000:01000000:3.0:1783951473.191329:0:5772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783951473.191332:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783951473.191335:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783951473.191336:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951473.191337:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1783951473.191339:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951473.191355:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951473.191357:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951473.191358:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783951473.191359:0:5772:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783951473.191361:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951473.191362:0:5772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783951473.191380:0:5772:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ad22fe79 from lustre-MDT0000 10000000:01000000:3.0:1783951473.191418:0:5772:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783951473.191421:0:5772:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783951473.191425:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e8d585e0000 10000000:01000000:3.0:1783951473.191429:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783951473.191437:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8d585e0000 from 1 10000000:01000000:3.0:1783951473.191440:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783951473.191483:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000c9ed46c2/0x443dabd358eec096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.191494:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000c9ed46c2/0x443dabd358eec096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.191503:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000c9ed46c2/0x443dabd358eec096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951473.191521:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aef914a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255360:0@lo:101: 00000100:00100000:3.0:1783951473.191556:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951473.191612:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000083425ac9 going to sleep for 11 seconds 00000100:00100000:1.0:1783951473.191705:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624255360 00000100:00100000:1.0:1783951473.191712:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624255360 00000100:00100000:1.0:1783951473.191757:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951473.191765:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001469c303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:5772:x1870608624255360:12345-0@lo:101: 00010000:00010000:1.0:1783951473.191778:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951473.191792:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000749cc42/0x443dabd358eec09d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec096 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.191853:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000749cc42/0x443dabd358eec09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec096 expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.191861:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000749cc42/0x443dabd358eec09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec096 expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.191871:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000749cc42, rc 0) 00000100:00100000:1.0:1783951473.191898:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001469c303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+6:5772:x1870608624255360:12345-0@lo:101: Request processed in 134us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.191904:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951473.192017:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aef914a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255360:0@lo:101: 00010000:00010000:3.0:1783951473.192029:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000c9ed46c2/0x443dabd358eec096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.192037:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000c9ed46c2/0x443dabd358eec096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951473.192092:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aef914a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255488:0@lo:501: 00000100:00100000:3.0:1783951473.192116:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951473.192141:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000083425ac9 going to sleep for 11 seconds 00000100:00100000:1.0:1783951473.192201:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624255488 00000100:00100000:1.0:1783951473.192205:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624255488 00000100:00100000:1.0:1783951473.192235:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951473.192243:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d23f0e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+6:5772:x1870608624255488:12345-0@lo:501: 00000100:00100000:1.0:1783951473.192489:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d23f0e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+6:5772:x1870608624255488:12345-0@lo:501: Request processed in 248us (372us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783951473.192496:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951473.192527:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aef914a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255488:0@lo:501: 10000000:01000000:1.0:1783951473.192551:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783951473.192563:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000c9ed46c2/0x443dabd358eec096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.192571:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000c9ed46c2/0x443dabd358eec096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951473.192579:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8d4535a000 10000000:01000000:1.0:1783951473.192583:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783951473.192591:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e8d4535a000 10000000:01000000:1.0:1783951473.192593:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783951473.192596:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8e8d4535a000 from 1 10000000:01000000:1.0:1783951473.192598:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783951473.192622:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000e1fad598/0x443dabd358eec0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.192629:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000e1fad598/0x443dabd358eec0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.192637:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000e1fad598/0x443dabd358eec0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951473.192648:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000af755218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255616:0@lo:101: 00000100:00100000:1.0:1783951473.192672:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951473.192691:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000008fe7b40b going to sleep for 11 seconds 00000100:00100000:0.0:1783951473.192749:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624255616 00000100:00100000:0.0:1783951473.192753:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624255616 00000100:00100000:0.0:1783951473.192780:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951473.192786:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f3c3f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+6:5772:x1870608624255616:12345-0@lo:101: 00010000:00010000:0.0:1783951473.192801:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951473.192831:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b037487/0x443dabd358eec0ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec0a4 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.192845:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b037487/0x443dabd358eec0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec0a4 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.192853:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b037487/0x443dabd358eec0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec0a4 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.192859:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b037487, rc 0) 00000100:00100000:0.0:1783951473.192885:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f3c3f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+7:5772:x1870608624255616:12345-0@lo:101: Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951473.192891:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951473.192960:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000af755218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255616:0@lo:101: 00010000:00010000:1.0:1783951473.192969:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000e1fad598/0x443dabd358eec0a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.192976:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000e1fad598/0x443dabd358eec0a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951473.192986:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783951473.193076:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000e1fad598/0x443dabd358eec0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.193083:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000e1fad598/0x443dabd358eec0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951473.193101:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783951473.193105:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951473.193108:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e8d4535a000 10000000:01000000:1.0:1783951473.193111:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783951473.193114:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783951473.193115:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951473.193128:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 0000000091f96d6c/0x443dabd358eec0b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.193134:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 0000000091f96d6c/0x443dabd358eec0b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.193140:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 0000000091f96d6c/0x443dabd358eec0b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951473.193150:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000af755218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255744:0@lo:101: 00000100:00100000:1.0:1783951473.193184:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951473.193204:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000008fe7b40b going to sleep for 11 seconds 00000100:00100000:0.0:1783951473.193572:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624255744 00000100:00100000:0.0:1783951473.193576:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624255744 00000100:00100000:0.0:1783951473.193627:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951473.193631:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3d527c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+7:5772:x1870608624255744:12345-0@lo:101: 00010000:00010000:0.0:1783951473.193637:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951473.193643:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041473b00/0x443dabd358eec0b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec0b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.193653:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041473b00/0x443dabd358eec0b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.193660:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041473b00/0x443dabd358eec0b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.193667:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041473b00, rc 0) 00000100:00100000:0.0:1783951473.193717:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3d527c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+8:5772:x1870608624255744:12345-0@lo:101: Request processed in 86us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951473.193722:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783951473.193766:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000af755218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255744:0@lo:101: 00010000:00010000:2.0:1783951473.193774:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 0000000091f96d6c/0x443dabd358eec0b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.193779:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 0000000091f96d6c/0x443dabd358eec0b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951473.193830:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255872:0@lo:501: 00000100:00100000:2.0:1783951473.193859:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951473.194006:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000087d82d63 going to sleep for 11 seconds 00000100:00100000:1.0:1783951473.194072:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624255872 00000100:00100000:1.0:1783951473.194075:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624255872 00000100:00100000:1.0:1783951473.194089:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951473.194092:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000186073e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+8:5772:x1870608624255872:12345-0@lo:501: 00000100:00100000:1.0:1783951473.194288:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000186073e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:5772:x1870608624255872:12345-0@lo:501: Request processed in 195us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.194293:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951473.194363:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624255872:0@lo:501: 00000100:00100000:2.0:1783951473.194391:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256000:0@lo:503: 00000100:00100000:2.0:1783951473.194425:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951473.194443:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000087d82d63 going to sleep for 11 seconds 00000100:00100000:1.0:1783951473.194484:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624256000 00000100:00100000:1.0:1783951473.194487:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624256000 00000100:00100000:1.0:1783951473.194506:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951473.194514:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028a4a71a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:5772:x1870608624256000:12345-0@lo:503: 00000100:00100000:1.0:1783951473.194624:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028a4a71a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:5772:x1870608624256000:12345-0@lo:503: Request processed in 110us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.194628:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951473.194738:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256000:0@lo:503: 00000100:00100000:2.0:1783951473.195021:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5814:1870608624256128:0@lo:502: 00000100:00100000:2.0:1783951473.195048:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951473.195069:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a106c238 going to sleep for 11 seconds 00000100:00100000:1.0:1783951473.195106:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624256128 00000100:00100000:1.0:1783951473.195110:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624256128 00000100:00100000:1.0:1783951473.195127:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951473.195131:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000098d8bee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:5814:x1870608624256128:12345-0@lo:502: 00000100:00100000:1.0:1783951473.195273:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000098d8bee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:5814:x1870608624256128:12345-0@lo:502: Request processed in 142us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.195277:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783951473.195331:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5814:1870608624256128:0@lo:502: 00000020:01000000:2.0:1783951473.195349:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951473.195361:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951473.195364:0:5814:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783951473.195369:0:5814:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783951473.195372:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951473.195404:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000088ffdd16) 00000020:00000080:2.0:1783951473.195427:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783951473.195432:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783951473.195500:0:5814:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783951473.195507:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eec0c7 00000020:00000080:2.0:1783951473.195763:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783951473.195767:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951473.195770:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951473.195771:0:5814:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783951473.195773:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951473.195775:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951473.195776:0:5814:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783951473.195778:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951473.195782:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007c3b1de5) 00000020:00000080:2.0:1783951473.195790:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783951473.195792:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783951473.195797:0:5814:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783951473.195800:0:5814:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783951473.195805:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783951473.195898:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad22fe79 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783951473.195907:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c090b9be) 00000020:00000080:2.0:1783951473.195913:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783951473.195950:0:5814:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783951473.195955:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eec0dc 00000020:00000080:2.0:1783951473.196050:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783951473.196056:0:5814:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783951473.196059:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x443dabd358eec0e3 00080000:01000000:2.0:1783951473.196063:0:5814:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783951473.196065:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eec0ea 00080000:10000000:2.0:1783951473.196414:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1783951473.196575:0:5814:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1783951473.199580:0:5814:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1783951473.256622:0:5814:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1783951473.257649:0:5814:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1783951473.260595:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1783951473.261189:0:5814:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783951473.301611:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006ab26f2c) 00000020:00000080:2.0:1783951473.301634:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783951473.301857:0:5814:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783951473.301865:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eec0f8 00000020:00000080:3.0:1783951473.302377:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783951473.305488:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951473.349134:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951473.380315:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951473.412301:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951473.450477:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783951473.483744:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1783951473.507404:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x443dabd358eec0ff 00000020:00000080:0.0:1783951473.508057:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783951473.508068:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951473.508075:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951473.508077:0:5814:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783951473.508080:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951473.508087:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951473.508088:0:5814:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783951473.508092:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783951473.508127:0:5814:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783951473.508141:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951473.508144:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951473.508146:0:5814:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783951473.508148:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951473.508151:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951473.508152:0:5814:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783951473.508155:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783951473.508157:0:5814:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783951473.508221:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000070288790 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5814:1870608624256256:0@lo:502: 00000100:00100000:0.0:1783951473.508296:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951473.508351:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0bc98a3 going to sleep for 11 seconds 00000100:00100000:1.0:1783951473.508438:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624256256 00000100:00100000:1.0:1783951473.508446:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624256256 00000100:00100000:1.0:1783951473.508516:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951473.508524:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088239f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:5814:x1870608624256256:12345-0@lo:502: 00000100:00100000:1.0:1783951473.509049:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088239f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:5814:x1870608624256256:12345-0@lo:502: Request processed in 410us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.509059:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783951473.509149:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000070288790 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5814:1870608624256256:0@lo:502: 00000020:01000000:3.0:1783951473.509184:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951473.509189:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951473.509191:0:5814:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783951473.509195:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1783951473.509487:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1783951473.509504:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783951473.509524:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 0000000091f96d6c/0x443dabd358eec0b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.509534:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 0000000091f96d6c/0x443dabd358eec0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951473.509553:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e8d4535a000 from 1 10000000:01000000:2.0:1783951473.509556:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951473.509583:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.509590:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.509598:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951473.509611:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256384:0@lo:101: 00000100:00100000:2.0:1783951473.509644:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951473.510064:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0644376 going to sleep for 11 seconds 00000100:00100000:3.0:1783951473.510129:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624256384 00000100:00100000:3.0:1783951473.510135:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624256384 00000100:00100000:3.0:1783951473.510183:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783951473.510191:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000713ce270 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:5772:x1870608624256384:12345-0@lo:101: 00010000:00010000:3.0:1783951473.510201:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951473.510212:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec106 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.510234:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec106 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.510244:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec106 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.510253:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fb3af6f, rc 0) 00000100:00100000:3.0:1783951473.510293:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000713ce270 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:5772:x1870608624256384:12345-0@lo:101: Request processed in 104us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951473.510310:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951473.510377:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256384:0@lo:101: 00010000:00010000:2.0:1783951473.510390:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.510398:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951473.511117:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256512:0@lo:256: 00000100:00100000:2.0:1783951473.511159:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951473.511187:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0644376 going to sleep for 11 seconds 00000100:00100000:3.0:1783951473.511239:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624256512 00000100:00100000:3.0:1783951473.511244:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624256512 00000100:00100000:3.0:1783951473.511265:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951473.511271:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b742aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:5772:x1870608624256512:12345-0@lo:256: 20000000:01000000:3.0:1783951473.511284:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783951473.511290:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1783951473.511352:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b742aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:5772:x1870608624256512:12345-0@lo:256: Request processed in 81us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951473.511359:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951473.511425:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256512:0@lo:256: 10000000:01000000:2.0:1783951473.512160:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951473.512278:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.512297:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951473.512305:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d4535a000 from 1 10000000:01000000:2.0:1783951473.512307:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951473.512331:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.512338:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.512347:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951473.512362:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256640:0@lo:101: 00000100:00100000:2.0:1783951473.512396:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951473.512429:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0644376 going to sleep for 11 seconds 00000100:00100000:1.0:1783951473.512489:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624256640 00000100:00100000:1.0:1783951473.512495:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624256640 00000100:00100000:1.0:1783951473.512531:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951473.512538:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088018624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:5772:x1870608624256640:12345-0@lo:101: 00010000:00010000:1.0:1783951473.512547:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951473.512558:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec114 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.512575:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec114 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.512590:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec114 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.512598:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de17d449, rc 0) 00000100:00100000:1.0:1783951473.512624:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088018624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5772:x1870608624256640:12345-0@lo:101: Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.512630:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783951473.512822:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256640:0@lo:101: 00010000:00010000:2.0:1783951473.512834:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.512843:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951473.512888:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256768:0@lo:501: 00000100:00100000:2.0:1783951473.512912:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951473.513023:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624256768 00000100:00100000:1.0:1783951473.513027:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624256768 00000100:00100000:1.0:1783951473.513049:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951473.513055:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5772:x1870608624256768:12345-0@lo:501: 00000100:00100000:1.0:1783951473.513536:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5772:x1870608624256768:12345-0@lo:501: Request processed in 482us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.513544:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783951473.513627:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0644376 going to sleep for 11 seconds 00000100:00100000:2.0:1783951473.513651:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256768:0@lo:501: 00000100:00100000:2.0:1783951473.513797:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256896:0@lo:503: 00000100:00100000:2.0:1783951473.513870:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951473.513883:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0644376 going to sleep for 11 seconds 00000100:00100000:1.0:1783951473.514015:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624256896 00000100:00100000:1.0:1783951473.514021:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624256896 00000100:00100000:1.0:1783951473.514054:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951473.514060:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000024269e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5772:x1870608624256896:12345-0@lo:503: 00000040:00080000:1.0:1783951473.514094:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783951473.514126:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000024269e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5772:x1870608624256896:12345-0@lo:503: Request processed in 67us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951473.514133:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951473.514284:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624256896:0@lo:503: 00000040:00080000:0.0:1783951473.515307:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783951473.516335:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783951473.516360:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951473.517597:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.517613:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951473.518050:0:5772:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783951473.518055:0:5772:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8d4535a000 10000000:01000000:1.0:1783951473.518057:0:5772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8d4535a000 10000000:01000000:1.0:1783951473.518060:0:5772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951473.518065:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d4535a000 from 1 10000000:01000000:1.0:1783951473.518081:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951473.518119:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000006461c075/0x443dabd358eec122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.518128:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000006461c075/0x443dabd358eec122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.518138:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000006461c075/0x443dabd358eec122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951473.518163:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624257024:0@lo:101: 00000100:00100000:1.0:1783951473.518246:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951473.518314:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f3032d2 going to sleep for 11 seconds 00000100:00100000:3.0:1783951473.518368:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624257024 00000100:00100000:3.0:1783951473.518375:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624257024 00000100:00100000:3.0:1783951473.518448:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951473.518456:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff1509c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5772:x1870608624257024:12345-0@lo:101: 00010000:00010000:3.0:1783951473.518468:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951473.518479:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b83e96de/0x443dabd358eec129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.518500:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b83e96de/0x443dabd358eec129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec122 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.518510:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b83e96de/0x443dabd358eec129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec122 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951473.518517:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b83e96de, rc 0) 00000100:00100000:3.0:1783951473.518561:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff1509c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5772:x1870608624257024:12345-0@lo:101: Request processed in 106us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951473.518568:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951473.518636:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624257024:0@lo:101: 00010000:00010000:1.0:1783951473.518649:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000006461c075/0x443dabd358eec122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951473.518656:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000006461c075/0x443dabd358eec122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951473.518709:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624257152:0@lo:501: 00000100:00100000:1.0:1783951473.518732:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951473.519060:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f3032d2 going to sleep for 11 seconds 00000100:00100000:0.0:1783951473.519140:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624257152 00000100:00100000:0.0:1783951473.519151:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624257152 00000100:00100000:0.0:1783951473.519184:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783951473.519190:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d347768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5772:x1870608624257152:12345-0@lo:501: 00000100:00100000:0.0:1783951473.519475:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d347768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5772:x1870608624257152:12345-0@lo:501: Request processed in 286us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951473.519483:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951473.519568:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624257152:0@lo:501: 00000100:00100000:1.0:1783951473.519597:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624257280:0@lo:503: 00000100:00100000:1.0:1783951473.519632:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951473.519776:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f3032d2 going to sleep for 11 seconds 00000100:00100000:2.0:1783951473.519803:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624257280 00000100:00100000:2.0:1783951473.519843:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624257280 00000100:00100000:0.0:1783951473.520037:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783951473.520045:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5310048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5772:x1870608624257280:12345-0@lo:503: 00000100:00100000:0.0:1783951473.520383:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5310048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5772:x1870608624257280:12345-0@lo:503: Request processed in 339us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951473.520390:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951473.520499:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624257280:0@lo:503: 00000100:00100000:1.0:1783951473.521025:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5819:1870608624257408:0@lo:502: 00000100:00100000:1.0:1783951473.521066:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951473.521194:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set 0000000070fbe2e9 going to sleep for 11 seconds 00000100:00100000:3.0:1783951473.521255:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624257408 00000100:00100000:3.0:1783951473.521261:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624257408 00000100:00100000:3.0:1783951473.521286:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783951473.521292:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089834c0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5819:x1870608624257408:12345-0@lo:502: 00000100:00100000:3.0:1783951473.521509:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089834c0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5819:x1870608624257408:12345-0@lo:502: Request processed in 216us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951473.521516:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951473.521593:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5819:1870608624257408:0@lo:502: 00000020:01000004:1.0:1783951473.521645:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783951473.521778:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001f321ff4) 00000020:00000080:1.0:1783951473.521798:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1783951473.522093:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad22fe79 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783951473.522098:0:5819:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ad22fe79 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783951473.522101:0:5819:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ad22fe79 4 00010000:00080000:1.0:1783951473.522129:0:5819:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e0d48f6f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:1.0:1783951473.527922:0:5819:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783951473.528175:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783951473.528211:0:5819:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783951473.528234:0:5819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x443dabd358eec137 00000100:00080000:1.0:1783951473.528242:0:5819:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783951473.528246:0:5819:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e0d48f6f using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783951473.528274:0:5819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000079e6e3df x1870608624257536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951473.528294:0:5819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783951473.528526:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624257536:0@lo:38: 00000100:00100000:3.0:1783951473.528581:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951473.528840:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e2e8e78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5819:1870608624257664:0@lo:502: 00000100:00100000:3.0:1783951473.528879:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951473.528901:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624257664 00000100:00100000:3.0:1783951473.528906:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624257664 00000100:00100000:0.0:1783951473.529035:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624257536 00000100:00100000:0.0:1783951473.529040:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624257536 00000100:00100000:0.0:1783951473.529061:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951473.529067:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee0d7965 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870608624257536:12345-0@lo:38: 00000100:00100000:3.0:1783951473.529512:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783951473.529520:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ede5685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5819:x1870608624257664:12345-0@lo:502: 00000100:00100000:0.0:1783951473.532373:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee0d7965 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870608624257536:12345-0@lo:38: Request processed in 3300us (3786us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783951473.532388:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951473.536601:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ede5685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5819:x1870608624257664:12345-0@lo:502: Request processed in 7076us (7715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951473.536616:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783951473.536802:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951473.536824:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000e0d48f6f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951473.536829:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783951473.536833:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000079e6e3df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624257536:0@lo:38: 00000100:00100000:3.0:1783951473.537037:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd50c00e going to sleep for 11 seconds 00000100:00100000:3.0:1783951473.537051:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e2e8e78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5819:1870608624257664:0@lo:502: 00000040:00080000:3.0:1783951473.537083:0:5819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1783951473.537285:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783951473.537304:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783951473.537323:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 000000006461c075/0x443dabd358eec122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951473.537334:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 000000006461c075/0x443dabd358eec122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783951473.537379:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783951473.537382:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951473.537383:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951473.537384:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951473.537385:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951473.537387:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951473.537388:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951473.537393:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951473.537395:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783951473.537396:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783951473.537397:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951473.537398:0:5772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783951473.537402:0:5772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783951473.537404:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783951473.537405:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951473.537406:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951473.537407:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951473.537408:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951473.537409:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951473.537409:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951473.537410:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951473.537411:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783951473.537412:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783951473.537413:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951473.537413:0:5772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783951473.537435:0:5772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783951473.537450:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624257792:0@lo:253: 00000100:00100000:2.0:1783951473.537490:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951473.537510:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0644376 going to sleep for 11 seconds 00000100:00100000:0.0:1783951473.538016:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624257792 00000100:00100000:0.0:1783951473.538024:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624257792 00000100:00100000:0.0:1783951473.538098:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783951473.538107:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001829dae5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5772:x1870608624257792:12345-0@lo:253: 20000000:01000000:0.0:1783951473.538133:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783951473.538146:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783951473.565072:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783951473.565087:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783951473.565120:0:5807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783951473.565125:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783951473.565155:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565184:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec106 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565191:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565231:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec106 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565246:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec106 expref: 12 pid: 5784 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951473.565260:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000031a00b2a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1870608624257920:0@lo:104: 00000100:00100000:0.0:1783951473.565319:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951473.565368:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0058fbe going to sleep for 11 seconds 00000100:00100000:0.0:1783951473.565396:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624257920 00000100:00100000:0.0:1783951473.565402:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624257920 00000100:00100000:0.0:1783951473.565443:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951473.565451:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e2b1463 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5807:x1870608624257920:12345-0@lo:104: 00010000:00010000:0.0:1783951473.565462:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565508:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951473.565513:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e2b1463 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5807:x1870608624257920:12345-0@lo:104: Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951473.565520:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783951473.565542:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951473.565552:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565559:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ebcc5220 already unused, calling callback (00000000ff6e00d1) 10000000:00010000:0.0:1783951473.565562:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565569:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951473.565574:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951473.565579:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951473.565605:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565611:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951473.565628:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565634:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: 00000000ebcc5220/0x443dabd358eec106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec10d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.565649:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951473.565651:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951473.565652:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951473.565839:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f7f3793d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624258048:0@lo:103: 00000100:00100000:0.0:1783951473.565868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951473.565929:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624258048 00000100:00100000:0.0:1783951473.566071:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624258048 00010000:00010000:0.0:1783951473.566094:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec106 expref: 13 pid: 5784 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951473.566156:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951473.566163:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a642ba07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:3313:x1870608624258048:12345-0@lo:103: 00010000:00010000:0.0:1783951473.566181:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951473.566186:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec106 expref: 13 pid: 5784 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566195:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec106 expref: 13 pid: 5784 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566210:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566218:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783951473.566229:0:5776:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001105570s 00010000:00010000:0.0:1783951473.566233:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566238:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566244:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566249:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566254:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f7325787 already unused, calling callback (00000000337e228e) 00010000:00010000:0.0:1783951473.566262:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566269:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566277:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566286:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951473.566314:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a642ba07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:3313:x1870608624258048:12345-0@lo:103: Request processed in 152us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951473.566319:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783951473.566568:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fb3af6f/0x443dabd358eec10d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec106 expref: 12 pid: 5784 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951473.566580:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000031a00b2a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1870608624257920:0@lo:104: 00010000:00010000:0.0:1783951473.566597:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566605:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566609:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951473.566614:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f7325787/0x443dabd358eec13e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951473.566638:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f7f3793d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624258048:0@lo:103: 00000100:00100000:1.0:1783951473.573925:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001829dae5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5772:x1870608624257792:12345-0@lo:253: Request processed in 35812us (36426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951473.574037:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5772:1870608624257792:0@lo:253: 10000000:01000000:2.0:1783951473.574055:0:5772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783951473.574058:0:5772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783951473.574060:0:5772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951473.574061:0:5772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951473.574063:0:5772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951473.574064:0:5772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951473.574065:0:5772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951473.574067:0:5772:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951473.574068:0:5772:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951473.574070:0:5772:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783951473.574071:0:5772:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783951473.574072:0:5772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951473.574074:0:5772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783951473.574087:0:5772:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783951473.574785:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00080000:10000000:0.0:1783951473.579894:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1783951473.580366:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783951473.580581:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1783951473.581373:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783951473.581598:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1783951473.581920:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1783951473.582627:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1783951473.583078:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1783951473.583281:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1783951473.583452:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1783951473.583775:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1783951473.584032:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1783951473.622014:0:5772:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783951473.646053:0:5772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783951473.646577:0:5825:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1783951473.650023:0:5824:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1783951473.650030:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1783951473.650325:0:5772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783951473.650509:0:5772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783951473.654649:0:5772:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783951473.655130:0:5772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783951473.655420:0:5772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951473.656550:0:5772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783951473.657392:0:5772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783951473.657429:0:5772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783951473.658037:0:5772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783951473.660782:0:5772:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1783951473.662101:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783951473.662220:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783951473.662370:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783951473.662508:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783951473.662662:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783951473.662863:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1783951473.663012:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1783951473.663141:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783951473.663290:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1783951473.663424:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1783951473.663569:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783951473.663737:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783951473.663920:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783951473.669070:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783951473.669348:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783951473.669514:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1783951473.669999:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783951473.670224:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783951473.670371:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783951473.670721:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1783951473.670907:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1783951473.671070:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783951473.671230:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1783951473.671427:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783951473.671590:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783951473.671741:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1783951473.671896:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783951473.672060:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783951473.672570:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783951473.672740:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783951473.673112:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783951473.675507:0:5772:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783951473.676154:0:5772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1783951473.694015:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1783951473.742446:0:5772:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783951473.742492:0:5772:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7fa41cb7988 00100000:10000000:0.0:1783951473.742503:0:5772:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783951473.743192:0:5772:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783951473.743213:0:5772:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783951473.743229:0:5772:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783951473.743255:0:5772:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1783951473.784636:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783951473.785082:0:5825:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783951473.785087:0:5825:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1783951473.910842:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951474.935482:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951475.958019:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951476.988365:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951478.006904:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783951478.411752:0:6068:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1783951478.646133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783951478.646143:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951478.646161:0:37:0:(import.c:65:import_set_state_nolock()) 00000000e0d48f6f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951478.646175:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e0d48f6f using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783951478.646197:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000031a00b2a x1870608624258304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951478.646335:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f7f3793d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624258176:0@lo:400: 00000100:00100000:2.0:1783951478.646424:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951478.646577:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624258176 00000100:00100000:0.0:1783951478.646590:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624258176 00000100:00100000:0.0:1783951478.646642:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951478.646650:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca5b508e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:3314:x1870608624258176:12345-0@lo:400: 00000100:00100000:0.0:1783951478.646707:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca5b508e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:3314:x1870608624258176:12345-0@lo:400: Request processed in 58us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951478.646714:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951478.646801:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f7f3793d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624258176:0@lo:400: 00000100:00100000:3.0:1783951478.647156:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000031a00b2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624258304:0@lo:38: 00000100:00100000:3.0:1783951478.647191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951478.648989:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624258304 00000100:00100000:2.0:1783951478.649007:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624258304 00000100:00100000:2.0:1783951478.649053:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951478.649060:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e2e8e78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1870608624258304:12345-0@lo:38: 00010000:00080000:2.0:1783951478.649101:0:5793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:2.0:1783951478.649142:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x443dabd358eec145 00000004:00100000:2.0:1783951478.649240:0:5793:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951478.649400:0:5793:0:(import.c:65:import_set_state_nolock()) 000000004e982330 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951478.649506:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e2e8e78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870608624258304:12345-0@lo:38: Request processed in 444us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951478.649514:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783951478.649569:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000031a00b2a x1870608624258304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951478.651306:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783951478.651323:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783951478.651330:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783951478.651333:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000e0d48f6f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783951478.651360:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000031a00b2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624258304:0@lo:38: 00010000:00010000:3.0:1783951479.040151:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783951479.673043:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783951479.673052:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e8d4535a000 from 3 10000000:01000000:2.0:1783951479.673057:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951479.673111:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000a36a57b9/0x443dabd358eec14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951479.673125:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000a36a57b9/0x443dabd358eec14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951479.673137:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000a36a57b9/0x443dabd358eec14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951479.673164:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624258432:0@lo:101: 00000100:00100000:2.0:1783951479.673238:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951479.673289:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bc26436e going to sleep for 11 seconds 00000100:00100000:3.0:1783951479.673371:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624258432 00000100:00100000:3.0:1783951479.673392:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624258432 00000100:00100000:3.0:1783951479.673452:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783951479.673461:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c925335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5788:x1870608624258432:12345-0@lo:101: 00010000:00010000:3.0:1783951479.673479:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951479.673495:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078f25fc7/0x443dabd358eec153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec14c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951479.673523:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078f25fc7/0x443dabd358eec153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec14c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951479.673535:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078f25fc7/0x443dabd358eec153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec14c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951479.673544:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078f25fc7, rc 0) 00000100:00100000:3.0:1783951479.673604:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c925335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624258432:12345-0@lo:101: Request processed in 144us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951479.673611:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783951479.673660:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7bcd8f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624258432:0@lo:101: 00010000:00010000:3.0:1783951479.673675:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000a36a57b9/0x443dabd358eec14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951479.673683:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000a36a57b9/0x443dabd358eec14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951479.673741:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001861e510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624258560:0@lo:256: 00000100:00100000:3.0:1783951479.673777:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951479.673790:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9bd7cf3 going to sleep for 11 seconds 00000100:00100000:3.0:1783951479.673804:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624258560 00000100:00100000:3.0:1783951479.673837:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624258560 00000100:00100000:3.0:1783951479.673858:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783951479.673864:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000494b6344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624258560:12345-0@lo:256: 20000000:01000000:3.0:1783951479.673877:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783951479.673891:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951479.673894:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783951479.673965:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000494b6344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624258560:12345-0@lo:256: Request processed in 102us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951479.673972:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783951479.674002:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001861e510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624258560:0@lo:256: 10000000:01000000:3.0:1783951479.674037:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783951479.674043:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000a36a57b9/0x443dabd358eec14c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951479.674051:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000a36a57b9/0x443dabd358eec14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951480.054053:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951481.081193:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951482.102177:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951483.126032:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783951483.574806:0:6269:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff20248e80 20000000:00000080:1.0:1783951483.574900:0:6269:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8d65c8e400 uarg=0000000000000000 20000000:01000000:1.0:1783951483.574935:0:6269:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783951483.574941:0:6269:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783951483.574946:0:6269:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783951483.577144:0:6269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1783951483.577591:0:6269:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1783951483.587575:0:6269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951483.593559:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783951483.593669:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1783951483.593746:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1783951483.593772:0:6269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783951483.593789:0:6269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951483.593856:0:6269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec114 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951483.593864:0:6269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951483.593903:0:6269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec114 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951483.593920:0:6269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec114 expref: 11 pid: 5784 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951483.593933:0:6269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001861e510 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6269:1870608624258688:0@lo:104: 00000100:00100000:3.0:1783951483.593992:0:6269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951483.594063:0:6269:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ed857910 going to sleep for 11 seconds 00000100:00100000:0.0:1783951483.594613:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624258688 00000100:00100000:0.0:1783951483.594622:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624258688 00000100:00100000:0.0:1783951483.594674:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951483.594682:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8564468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:6269:x1870608624258688:12345-0@lo:104: 00010000:00010000:0.0:1783951483.594784:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951483.595052:0:6269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001861e510 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6269:1870608624258688:0@lo:104: 00010000:00010000:3.0:1783951483.595073:0:6269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951483.595156:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951483.595162:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8564468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:6269:x1870608624258688:12345-0@lo:104: Request processed in 481us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951483.595170:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783951483.595978:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951483.595986:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596005:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e8685e4 already unused, calling callback (00000000ff6e00d1) 10000000:00010000:1.0:1783951483.596008:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596016:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951483.596023:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951483.596047:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951483.596088:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596095:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951483.596123:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596131:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: 000000004e8685e4/0x443dabd358eec114 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec11b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596160:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951483.596163:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951483.596164:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951483.596223:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077126aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624258816:0@lo:103: 00000100:00100000:2.0:1783951483.596285:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951483.596525:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624258816 00000100:00100000:1.0:1783951483.596532:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624258816 00010000:00010000:1.0:1783951483.596557:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec114 expref: 12 pid: 5784 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951483.596592:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951483.596600:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cceb869d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:3315:x1870608624258816:12345-0@lo:103: 00010000:00010000:1.0:1783951483.596610:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951483.596615:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec114 expref: 12 pid: 5784 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596624:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec114 expref: 12 pid: 5784 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596636:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de17d449/0x443dabd358eec11b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec114 expref: 12 pid: 5784 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596654:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596661:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596673:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596680:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596686:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596703:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596708:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000556c592 already unused, calling callback (00000000337e228e) 00010000:00010000:1.0:1783951483.596711:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596718:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596729:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951483.596737:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951483.596771:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cceb869d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:3315:x1870608624258816:12345-0@lo:103: Request processed in 173us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951483.596785:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951483.596833:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077126aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624258816:0@lo:103: 00010000:00010000:3.0:1783951483.597092:0:6269:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951483.597100:0:6269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951483.597105:0:6269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000556c592/0x443dabd358eec15a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951483.767113:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951483.767135:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077126aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624258944:0@lo:400: 00000100:00100000:1.0:1783951483.767206:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951483.767278:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624258944 00000100:00100000:1.0:1783951483.767285:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624258944 00000100:00100000:1.0:1783951483.767332:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951483.767339:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464edf82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624258944:12345-0@lo:400: 00000100:00100000:1.0:1783951483.767387:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464edf82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624258944:12345-0@lo:400: Request processed in 49us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951483.767395:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783951483.767435:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000077126aa9 x1870608624258944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951483.767448:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077126aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624258944:0@lo:400: 00010000:00010000:3.0:1783951484.150293:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783951485.177838:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783951485.177858:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d4535a000 from 1 10000000:01000000:2.0:1783951485.177878:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951485.177961:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000004a79566c/0x443dabd358eec161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951485.177991:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000004a79566c/0x443dabd358eec161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951485.178006:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000004a79566c/0x443dabd358eec161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951485.178059:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a6929ff6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624259072:0@lo:101: 00000100:00100000:2.0:1783951485.178182:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951485.178253:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9bd7cf3 going to sleep for 11 seconds 00000100:00100000:3.0:1783951485.178597:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624259072 00000100:00100000:3.0:1783951485.178607:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624259072 00000100:00100000:3.0:1783951485.178993:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951485.179005:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061f1d31a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:5788:x1870608624259072:12345-0@lo:101: 00010000:00010000:3.0:1783951485.179029:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951485.179053:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000719ce488/0x443dabd358eec168 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec161 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951485.179087:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000719ce488/0x443dabd358eec168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec161 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951485.179100:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000719ce488/0x443dabd358eec168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec161 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951485.179113:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000719ce488, rc 0) 00000100:00100000:3.0:1783951485.179183:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061f1d31a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624259072:12345-0@lo:101: Request processed in 181us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951485.179192:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783951485.179374:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a6929ff6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624259072:0@lo:101: 00010000:00010000:2.0:1783951485.179396:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000004a79566c/0x443dabd358eec161 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951485.179406:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000004a79566c/0x443dabd358eec161 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951485.179541:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a6929ff6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624259200:0@lo:501: 00000100:00100000:2.0:1783951485.179581:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951485.179609:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9bd7cf3 going to sleep for 11 seconds 00000100:00100000:3.0:1783951485.179996:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624259200 00000100:00100000:3.0:1783951485.180003:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624259200 00000100:00100000:3.0:1783951485.180035:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951485.180041:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005be5551c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624259200:12345-0@lo:501: 00000100:00100000:3.0:1783951485.180376:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005be5551c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624259200:12345-0@lo:501: Request processed in 334us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951485.180384:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951485.180836:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a6929ff6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624259200:0@lo:501: 00000100:00100000:2.0:1783951485.180962:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a6929ff6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624259328:0@lo:503: 00000100:00100000:2.0:1783951485.181037:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951485.181062:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9bd7cf3 going to sleep for 11 seconds 00000100:00100000:3.0:1783951485.182330:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624259328 00000100:00100000:3.0:1783951485.182342:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624259328 00000100:00100000:3.0:1783951485.182395:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951485.182404:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4a3a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624259328:12345-0@lo:503: 00000100:00100000:3.0:1783951485.182731:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4a3a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624259328:12345-0@lo:503: Request processed in 328us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951485.182741:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783951485.187238:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a6929ff6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624259328:0@lo:503: 00000100:00100000:2.0:1783951485.187717:0:6331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a6929ff6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6331:1870608624259456:0@lo:502: 00000100:00100000:2.0:1783951485.187982:0:6331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951485.188035:0:6331:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020d45436 going to sleep for 11 seconds 00000100:00100000:3.0:1783951485.189859:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624259456 00000100:00100000:3.0:1783951485.190016:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624259456 00000100:00100000:3.0:1783951485.190088:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783951485.190097:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5c9f1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6331:x1870608624259456:12345-0@lo:502: 00000100:00100000:3.0:1783951485.190571:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5c9f1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6331:x1870608624259456:12345-0@lo:502: Request processed in 473us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951485.190580:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783951485.191299:0:6331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a6929ff6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6331:1870608624259456:0@lo:502: 00000020:01000000:2.0:1783951485.191352:0:6331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951485.191368:0:6331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951485.191381:0:6331:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783951485.191393:0:6331:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d4535a000 00000020:00000080:2.0:1783951485.191396:0:6331:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783951485.191555:0:6331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6331:1870608624259584:0@lo:502: 00000100:00100000:2.0:1783951485.191625:0:6331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951485.191987:0:6331:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951485.192100:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624259584 00000100:00100000:3.0:1783951485.192109:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624259584 00000100:00100000:3.0:1783951485.192169:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951485.192180:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6331:x1870608624259584:12345-0@lo:502: 00000100:00100000:3.0:1783951485.192447:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6331:x1870608624259584:12345-0@lo:502: Request processed in 267us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951485.192455:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951485.192950:0:6331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6331:1870608624259584:0@lo:502: 00000020:01000000:2.0:1783951485.192997:0:6331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951485.193007:0:6331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951485.193009:0:6331:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783951485.193015:0:6331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1783951485.193580:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783951485.193601:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951485.193615:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951485.193629:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951485.195322:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951486.198259:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951487.222253:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951488.246542:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951488.892674:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624259840:0@lo:400: 00000100:00100000:2.0:1783951488.892749:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951488.892851:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624259840 00000100:00100000:2.0:1783951488.892858:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624259840 00000100:00100000:2.0:1783951488.892900:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951488.892920:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624259840:12345-0@lo:400: 00000100:00100000:2.0:1783951488.892971:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624259840:12345-0@lo:400: Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951488.892978:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783951488.893017:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8d5855d500 x1870608624259840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951488.893031:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624259840:0@lo:400: 00000100:00100000:3.0:1783951488.893128:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951488.893149:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624259712:0@lo:400: 00000100:00100000:3.0:1783951488.893184:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951488.893452:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624259712 00000100:00100000:2.0:1783951488.893457:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624259712 00000100:00100000:2.0:1783951488.894423:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783951488.894434:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:3312:x1870608624259712:12345-0@lo:400: 00000100:00100000:2.0:1783951488.894506:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:3312:x1870608624259712:12345-0@lo:400: Request processed in 74us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951488.894514:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951488.894778:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624259712:0@lo:400: 00010000:00010000:2.0:1783951489.269953:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783951489.298132:0:6587:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783951489.298137:0:6587:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1783951489.298267:0:6587:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8d604cd800 00000020:01000004:2.0:1783951489.298283:0:6587:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783951489.298295:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783951489.298317:0:6587:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e8d605399c0) 00000020:00000080:2.0:1783951489.298334:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783951489.319099:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1783951489.319284:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783951489.344212:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783951489.353141:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783951489.353178:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783951489.353235:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783951489.353257:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783951489.353980:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783951489.353991:0:6587:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783951489.354001:0:6587:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x443dabd358eec176 00000020:01000004:2.0:1783951489.354008:0:6587:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783951489.354027:0:6587:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783951489.354030:0:6587:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783951489.354036:0:6587:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783951489.354040:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783951489.354050:0:6587:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e8d6053cd40) 00000020:00000080:2.0:1783951489.354071:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1783951489.355407:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951489.355595:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783951489.355602:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783951489.357086:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783951489.357098:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783951489.359529:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783951489.359540:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783951489.363878:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783951489.364036:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783951489.364042:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783951489.370385:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783951489.370396:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783951489.408229:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951489.408684:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783951489.408691:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1783951489.411374:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783951489.411389:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783951489.412935:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783951489.412944:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783951489.422709:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951489.424177:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783951489.424185:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783951489.427253:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783951489.427276:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783951489.489770:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951489.490063:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783951489.490071:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783951489.493263:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783951489.493277:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783951489.493689:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783951489.493715:0:6587:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783951489.493722:0:6587:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783951489.546702:0:6587:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783951489.546738:0:6587:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1783951489.546743:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783951489.546745:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951489.546747:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951489.546748:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951489.546749:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951489.546750:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951489.546752:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951489.546753:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783951489.546754:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783951489.546755:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951489.546756:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951489.546760:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1783951489.546762:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951489.546763:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951489.546764:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951489.546765:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951489.546766:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951489.546767:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951489.546768:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951489.546769:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783951489.546770:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783951489.546771:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951489.546772:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951489.546797:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783951489.546854:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624259968:0@lo:253: 00000100:00100000:0.0:1783951489.546936:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951489.546995:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d4557a480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951489.548194:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624259968 00000100:00100000:3.0:1783951489.548207:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624259968 00000100:00100000:3.0:1783951489.548270:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783951489.548280:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624259968:12345-0@lo:253: 20000000:01000000:3.0:1783951489.548330:0:5784:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783951489.548335:0:5784:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1783951489.548340:0:5784:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1783951489.548343:0:5784:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1783951489.549689:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951489.549934:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1783951489.549950:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1783951489.549995:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1783951489.550004:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1783951489.550037:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1783951489.550091:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1783951489.550479:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1783951489.550499:0:5784:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:3.0:1783951489.550501:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:3.0:1783951489.550539:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1783951489.550556:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783951489.550607:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1783951489.550615:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:3.0:1783951489.550650:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1783951489.550660:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783951489.550710:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1783951489.550766:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1783951489.555387:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1783951489.556676:0:5784:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:3.0:1783951489.556683:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:3.0:1783951489.556795:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1783951489.556867:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783951489.556922:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1783951489.556931:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:3.0:1783951489.557009:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1783951489.557021:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783951489.557056:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1783951489.557098:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1783951489.557278:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1783951489.557281:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1783951489.557287:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783951489.557288:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783951489.557290:0:5784:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783951489.557304:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783951489.557307:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783951489.557349:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783951489.557352:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783951489.561962:0:6602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1783951489.562132:0:6602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1783951489.562208:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1783951489.569182:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1783951489.569245:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1783951489.569324:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1783951489.569346:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783951489.569349:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783951489.570708:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1783951489.574415:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1783951489.574639:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1783951489.574723:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1783951489.574739:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783951489.574742:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783951489.575762:0:6604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1783951489.575979:0:6604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1783951489.576036:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1783951489.576380:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1783951489.576431:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1783951489.579794:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1783951489.579933:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783951489.579953:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.579985:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d60d5ee00/0x443dabd358eec09d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec096 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.579992:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d40031800/0x443dabd358eec0b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.579999:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec122 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.580006:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.580052:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec122 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.580068:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec122 expref: 12 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951489.580083:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624260096:0@lo:104: 00000100:00100000:3.0:1783951489.580159:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951489.580319:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d40031800/0x443dabd358eec0b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.580329:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d40031800/0x443dabd358eec0b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 12 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951489.580338:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624260224:0@lo:104: 00000100:00100000:3.0:1783951489.580362:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951489.580463:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d60d5ee00/0x443dabd358eec09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec096 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.580479:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d60d5ee00/0x443dabd358eec09d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec096 expref: 12 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951489.580488:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624260352:0@lo:104: 00000100:00100000:3.0:1783951489.580512:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951489.580695:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624260096 00000100:00100000:0.0:1783951489.580704:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624260096 00000100:00100000:0.0:1783951489.580748:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624260224 00000100:00100000:0.0:1783951489.580751:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624260224 00000100:00100000:0.0:1783951489.580776:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951489.580783:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:5784:x1870608624260096:12345-0@lo:104: 00010000:00010000:0.0:1783951489.580794:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.580888:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951489.580905:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:5784:x1870608624260096:12345-0@lo:104: Request processed in 112us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951489.580913:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951489.580930:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783951489.580936:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5784:x1870608624260224:12345-0@lo:104: 00010000:00010000:0.0:1783951489.580943:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.580974:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783951489.580979:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5784:x1870608624260224:12345-0@lo:104: Request processed in 44us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951489.580984:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1783951489.581061:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951489.581068:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581075:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5f000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951489.581088:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581096:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951489.581103:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951489.581109:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951489.581147:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581153:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951489.581171:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec122 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581177:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec129 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581191:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951489.581194:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581200:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5fa00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951489.581203:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581209:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951489.581225:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951489.581230:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951489.581244:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec0b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581249:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951489.581266:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec0b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581272:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec0b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec0b9 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581281:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951489.581283:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951489.581285:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951489.581298:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624260480:0@lo:103: 00000100:00100000:1.0:1783951489.581330:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.581375:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624260608:0@lo:103: 00000100:00100000:1.0:1783951489.581395:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.581595:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624260480 00000100:00100000:1.0:1783951489.581600:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624260480 00010000:00010000:1.0:1783951489.581622:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec129 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec122 expref: 13 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.581644:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624260608 00000100:00100000:1.0:1783951489.581648:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624260608 00010000:00010000:1.0:1783951489.581659:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d40031800/0x443dabd358eec0b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 14 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.581679:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951489.581687:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:3315:x1870608624260480:12345-0@lo:103: 00010000:00010000:1.0:1783951489.581697:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951489.581702:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec129 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec122 expref: 14 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581713:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec122 expref: 14 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581729:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951489.581761:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:3315:x1870608624260480:12345-0@lo:103: Request processed in 75us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.581767:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951489.581780:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951489.581785:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:3312:x1870608624260608:12345-0@lo:103: 00010000:00010000:1.0:1783951489.581793:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951489.581797:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d40031800/0x443dabd358eec0b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 13 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581805:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d40031800/0x443dabd358eec0b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 13 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.581844:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951489.581869:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:3312:x1870608624260608:12345-0@lo:103: Request processed in 84us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.581874:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951489.581923:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624260608:0@lo:103: 00000100:00100000:1.0:1783951489.581956:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624260480:0@lo:103: 00010000:00010000:1.0:1783951489.581985:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951489.582148:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de6b40 going to sleep for 11 seconds 00010000:00010000:3.0:1783951489.582164:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec122 expref: 12 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951489.582175:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624260096:0@lo:104: 00010000:00010000:3.0:1783951489.582184:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d40031800/0x443dabd358eec0b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec0b2 expref: 11 pid: 5784 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951489.582193:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624260224:0@lo:104: 00000100:00100000:2.0:1783951489.582244:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624260352 00000100:00100000:2.0:1783951489.582249:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624260352 00000100:00100000:0.0:1783951489.582294:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951489.582302:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5784:x1870608624260352:12345-0@lo:104: 00010000:00010000:0.0:1783951489.582311:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.582399:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951489.582405:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5784:x1870608624260352:12345-0@lo:104: Request processed in 105us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951489.582411:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783951489.582715:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951489.582720:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.582728:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41512000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951489.582732:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.582740:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951489.582746:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951489.582751:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951489.582783:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.582790:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951489.582804:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec096 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.582834:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec09d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.582850:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951489.582852:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951489.582853:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951489.582871:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624260736:0@lo:103: 00000100:00100000:1.0:1783951489.582967:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.583009:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624260736 00000100:00100000:1.0:1783951489.583012:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624260736 00010000:00010000:1.0:1783951489.583028:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d60d5ee00/0x443dabd358eec09d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec096 expref: 11 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.583045:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951489.583052:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:3313:x1870608624260736:12345-0@lo:103: 00010000:00010000:1.0:1783951489.583060:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951489.583064:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d60d5ee00/0x443dabd358eec09d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec096 expref: 11 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583072:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d60d5ee00/0x443dabd358eec09d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec096 expref: 11 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583087:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583096:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583112:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583120:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583127:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583144:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583150:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41513400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951489.583154:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583161:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583169:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.583179:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951489.583209:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:3313:x1870608624260736:12345-0@lo:103: Request processed in 157us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.583215:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951489.583243:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624260736:0@lo:103: 00010000:00010000:3.0:1783951489.583961:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5ee00/0x443dabd358eec09d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec096 expref: 10 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951489.583974:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624260352:0@lo:104: 00010000:00010000:3.0:1783951489.584001:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.584009:0:5784:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.584015:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.584020:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41513400/0x443dabd358eec184 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951489.584043:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783951489.626599:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:6587:x1870608624259968:12345-0@lo:253: Request processed in 78309us (79652us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951489.626614:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951489.626788:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624259968:0@lo:253: 10000000:01000000:1.0:1783951489.626806:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783951489.626828:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783951489.626830:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951489.626832:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951489.626833:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1783951489.626834:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951489.626836:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951489.626838:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951489.626839:0:6587:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783951489.626841:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951489.626843:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783951489.626876:0:6587:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8d604cd800 from lustre-OST0000 10000000:01000000:1.0:1783951489.626915:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783951489.626918:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783951489.626924:0:6587:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8d585e0000 local copy 10000000:01000000:1.0:1783951489.626929:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783951489.626971:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.626985:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.626995:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.627017:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624260864:0@lo:101: 00000100:00100000:1.0:1783951489.627056:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.627108:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628540 going to sleep for 11 seconds 00000100:00100000:3.0:1783951489.627225:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624260864 00000100:00100000:3.0:1783951489.627232:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624260864 00000100:00100000:3.0:1783951489.627279:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783951489.627289:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:6587:x1870608624260864:12345-0@lo:101: 00010000:00010000:3.0:1783951489.627303:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951489.627318:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d41513400/0x443dabd358eec192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec18b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.627344:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d41513400/0x443dabd358eec192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec18b expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.627353:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d41513400/0x443dabd358eec192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec18b expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.627362:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d41513400, rc 0) 00000100:00100000:3.0:1783951489.627447:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:6587:x1870608624260864:12345-0@lo:101: Request processed in 158us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951489.627453:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951489.627713:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624260864:0@lo:101: 00010000:00010000:1.0:1783951489.627727:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.627736:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.627941:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624260992:0@lo:501: 00000100:00100000:1.0:1783951489.627969:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.628039:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628540 going to sleep for 11 seconds 00000100:00100000:3.0:1783951489.628082:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624260992 00000100:00100000:3.0:1783951489.628087:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624260992 00000100:00100000:3.0:1783951489.628154:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951489.628161:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:6587:x1870608624260992:12345-0@lo:501: 00000100:00100000:3.0:1783951489.628370:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:6587:x1870608624260992:12345-0@lo:501: Request processed in 208us (399us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783951489.628383:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951489.628466:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624260992:0@lo:501: 10000000:01000000:1.0:1783951489.628479:0:6587:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783951489.628513:0:6587:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783951489.628519:0:6587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.628528:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.628535:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.628563:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783951489.628582:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8d604cd800 10000000:01000000:1.0:1783951489.628587:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783951489.628591:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e8d585e0000 10000000:01000000:1.0:1783951489.628594:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783951489.628597:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8e8d585e0000 from 1 10000000:01000000:1.0:1783951489.628600:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783951489.628619:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.628627:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.628635:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.628648:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261120:0@lo:101: 00000100:00100000:1.0:1783951489.628675:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783951489.628718:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951489.628731:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.628738:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5fa00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951489.628743:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.628751:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951489.628757:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951489.628763:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951489.628784:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.628790:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951489.628831:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.628838:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fa00/0x443dabd358eec18b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x443dabd358eec192 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.628854:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951489.628856:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951489.628857:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951489.629175:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951489.629193:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624261248:0@lo:103: 00000100:00100000:1.0:1783951489.629227:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.629266:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624261248 00000100:00100000:1.0:1783951489.629270:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624261248 00000100:00100000:1.0:1783951489.629307:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951489.629314:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:3314:x1870608624261248:12345-0@lo:103: 00010000:00010000:1.0:1783951489.629325:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951489.629340:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41513400/0x443dabd358eec192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec18b expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.629357:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951489.629386:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:3314:x1870608624261248:12345-0@lo:103: Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.629406:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951489.629440:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624261248:0@lo:103: 00000100:00100000:2.0:1783951489.629605:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624261120 00000100:00100000:2.0:1783951489.629611:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624261120 00000100:00100000:2.0:1783951489.629635:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783951489.629642:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+9:6587:x1870608624261120:12345-0@lo:101: 00010000:00010000:2.0:1783951489.629652:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951489.629676:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165e800/0x443dabd358eec1a0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec199 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951489.629695:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165e800/0x443dabd358eec1a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec199 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951489.629704:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165e800/0x443dabd358eec1a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec199 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951489.629711:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e800, rc 0) 00000100:00100000:2.0:1783951489.629751:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:6587:x1870608624261120:12345-0@lo:101: Request processed in 110us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.629757:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951489.629920:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261120:0@lo:101: 00010000:00010000:1.0:1783951489.629933:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1a0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.629941:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec1a0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951489.629955:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783951489.629974:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1a0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.629980:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1a0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951489.630003:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783951489.630007:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951489.630012:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783951489.630014:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951489.630800:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.630834:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.630843:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.630861:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261376:0@lo:101: 00000100:00100000:1.0:1783951489.630914:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.631045:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951489.631113:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624261376 00000100:00100000:0.0:1783951489.631119:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624261376 00000100:00100000:3.0:1783951489.631191:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951489.631202:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+10:6587:x1870608624261376:12345-0@lo:101: 00010000:00010000:3.0:1783951489.631212:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951489.631224:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec1a7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.631242:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.631249:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.631257:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d41513e00, rc 0) 00000100:00100000:3.0:1783951489.631328:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261376:12345-0@lo:101: Request processed in 128us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951489.631334:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783951489.631663:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261376:0@lo:101: 00010000:00010000:1.0:1783951489.631678:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.631687:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.631794:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261504:0@lo:501: 00000100:00100000:1.0:1783951489.631843:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.631918:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951489.633534:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624261504 00000100:00100000:3.0:1783951489.633546:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624261504 00000100:00100000:1.0:1783951489.639727:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951489.639760:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261504:12345-0@lo:501: 00000100:00100000:1.0:1783951489.640177:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261504:12345-0@lo:501: Request processed in 420us (8332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.640186:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783951489.640882:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261504:0@lo:501: 00000100:00100000:0.0:1783951489.640947:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261632:0@lo:503: 00000100:00100000:0.0:1783951489.641002:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951489.641041:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d43500c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951489.644245:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624261632 00000100:00100000:3.0:1783951489.644261:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624261632 00000100:00100000:3.0:1783951489.644327:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783951489.644337:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261632:12345-0@lo:503: 00000100:00100000:3.0:1783951489.644742:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261632:12345-0@lo:503: Request processed in 404us (3738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951489.644749:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783951489.644861:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261632:0@lo:503: 00000040:00080000:2.0:1783951489.645205:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951489.645291:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261760:0@lo:502: 00000100:00100000:2.0:1783951489.645339:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951489.645373:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81592b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951489.645640:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624261760 00000100:00100000:3.0:1783951489.645646:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624261760 00000100:00100000:3.0:1783951489.645697:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783951489.645705:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261760:12345-0@lo:502: 00000100:00100000:3.0:1783951489.645906:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261760:12345-0@lo:502: Request processed in 201us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951489.645914:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951489.646114:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261760:0@lo:502: 00000040:00080000:2.0:1783951489.646380:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783951489.646448:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783951489.646621:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783951489.646674:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783951489.646715:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783951489.646753:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783951489.646783:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261888:0@lo:502: 00000100:00100000:2.0:1783951489.646859:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951489.646884:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81592b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951489.646915:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624261888 00000100:00100000:2.0:1783951489.646926:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624261888 00000100:00100000:2.0:1783951489.646963:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951489.646969:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261888:12345-0@lo:502: 00000100:00100000:2.0:1783951489.647123:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624261888:12345-0@lo:502: Request processed in 153us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.647130:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951489.647177:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624261888:0@lo:502: 00000040:00080000:2.0:1783951489.647255:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783951489.647265:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1783951489.648862:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951489.648872:0:6606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1783951489.648879:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951489.648881:0:6606:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783951489.648886:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951489.648920:0:6606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e8d7f853380) 00000020:00000080:3.0:1783951489.648941:0:6606:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783951489.648948:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783951489.649007:0:6606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8d604cd800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783951489.649014:0:6606:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783951489.649020:0:6606:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x443dabd358eec1bc 00010000:00010000:2.0:1783951489.657577:0:6606:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1783951489.658202:0:6606:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783951489.664566:0:6606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783951489.665930:0:6606:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1783951489.678204:0:6606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1783951489.679048:0:6606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1783951489.698062:0:6606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783951489.698078:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951489.698086:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951489.698088:0:6606:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783951489.698093:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951489.698099:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951489.698100:0:6606:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783951489.698103:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783951489.698106:0:6606:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783951489.698185:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951489.698189:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951489.698191:0:6606:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783951489.698194:0:6606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783951489.702609:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1783951489.702655:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783951489.702682:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.702706:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951489.702714:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d604cd800 from 1 10000000:01000000:3.0:1783951489.702717:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951489.702760:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.702768:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.702793:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951489.702869:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262016:0@lo:101: 00000100:00100000:3.0:1783951489.702965:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951489.703018:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951489.703249:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624262016 00000100:00100000:2.0:1783951489.703258:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624262016 00000100:00100000:2.0:1783951489.703307:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783951489.703317:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:6587:x1870608624262016:12345-0@lo:101: 00010000:00010000:2.0:1783951489.703331:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951489.703344:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec1c3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951489.703381:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951489.703391:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951489.703410:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fe00, rc 0) 00000100:00100000:2.0:1783951489.703451:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262016:12345-0@lo:101: Request processed in 136us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.703471:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783951489.704193:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262016:0@lo:101: 00010000:00010000:3.0:1783951489.704211:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.704221:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951489.704341:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262144:0@lo:501: 00000100:00100000:3.0:1783951489.704374:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951489.704410:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951489.704492:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624262144 00000100:00100000:1.0:1783951489.704498:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624262144 00000100:00100000:1.0:1783951489.704530:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951489.704539:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262144:12345-0@lo:501: 00000100:00100000:1.0:1783951489.704790:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262144:12345-0@lo:501: Request processed in 251us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.704799:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783951489.705137:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262144:0@lo:501: 00000100:00100000:3.0:1783951489.705168:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262272:0@lo:503: 00000100:00100000:3.0:1783951489.705209:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951489.705231:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951489.705291:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624262272 00000100:00100000:1.0:1783951489.705296:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624262272 00000100:00100000:1.0:1783951489.705327:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951489.705335:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262272:12345-0@lo:503: 00000100:00100000:1.0:1783951489.705902:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262272:12345-0@lo:503: Request processed in 556us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.705911:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783951489.706007:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262272:0@lo:503: 00000040:00080000:3.0:1783951489.706330:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951489.706390:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262400:0@lo:502: 00000100:00100000:3.0:1783951489.706430:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951489.706588:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951489.706677:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624262400 00000100:00100000:2.0:1783951489.706682:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624262400 00000100:00100000:2.0:1783951489.706725:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951489.706733:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262400:12345-0@lo:502: 00000100:00100000:2.0:1783951489.706931:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262400:12345-0@lo:502: Request processed in 198us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.706938:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783951489.707081:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262400:0@lo:502: 00000040:00080000:3.0:1783951489.707320:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783951489.707375:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783951489.707401:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262528:0@lo:502: 00000100:00100000:3.0:1783951489.707450:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951489.707601:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951489.708836:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624262528 00000100:00100000:1.0:1783951489.708844:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624262528 00000100:00100000:1.0:1783951489.708908:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951489.708918:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262528:12345-0@lo:502: 00000100:00100000:1.0:1783951489.709148:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262528:12345-0@lo:502: Request processed in 232us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.709156:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951489.709223:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262528:0@lo:502: 00000040:00080000:1.0:1783951489.709370:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783951489.709384:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783951489.721045:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951489.721064:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951489.721067:0:6610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783951489.721075:0:6610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d604cd800 00000020:00000080:3.0:1783951489.721077:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951489.721102:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951489.721106:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951489.721107:0:6610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783951489.721110:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783951489.727799:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783951489.728059:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951489.729709:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.729729:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951489.729795:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783951489.729799:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8d604cd800 10000000:01000000:1.0:1783951489.729803:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8d604cd800 10000000:01000000:1.0:1783951489.729807:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951489.729828:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d604cd800 from 1 10000000:01000000:1.0:1783951489.729831:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951489.729871:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.729879:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.729900:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.729926:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262656:0@lo:101: 00000100:00100000:1.0:1783951489.730001:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.730124:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951489.733635:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624262656 00000100:00100000:2.0:1783951489.733651:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624262656 00000100:00100000:3.0:1783951489.734673:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783951489.734687:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624262656:12345-0@lo:101: 00010000:00010000:3.0:1783951489.734708:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951489.734732:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec1d1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.734768:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.734783:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951489.734794:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d41513400, rc 0) 00000100:00100000:3.0:1783951489.734925:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624262656:12345-0@lo:101: Request processed in 240us (4923us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951489.734950:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783951489.735078:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262656:0@lo:101: 00010000:00010000:1.0:1783951489.735101:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.735119:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.735246:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262784:0@lo:501: 00000100:00100000:1.0:1783951489.735284:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.735324:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951489.735390:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624262784 00000100:00100000:2.0:1783951489.735397:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624262784 00000100:00100000:2.0:1783951489.735431:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783951489.735449:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624262784:12345-0@lo:501: 00000100:00100000:2.0:1783951489.735712:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624262784:12345-0@lo:501: Request processed in 264us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.735719:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783951489.736204:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262784:0@lo:501: 00000100:00100000:1.0:1783951489.736242:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262912:0@lo:503: 00000100:00100000:1.0:1783951489.736288:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.736309:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951489.736378:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624262912 00000100:00100000:3.0:1783951489.736383:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624262912 00000100:00100000:3.0:1783951489.736422:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783951489.736429:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624262912:12345-0@lo:503: 00000100:00100000:3.0:1783951489.736605:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624262912:12345-0@lo:503: Request processed in 175us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951489.736612:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951489.736771:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624262912:0@lo:503: 00000040:00080000:1.0:1783951489.737139:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783951489.737195:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624263040:0@lo:502: 00000100:00100000:1.0:1783951489.737232:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.737251:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951489.737321:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624263040 00000100:00100000:2.0:1783951489.737327:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624263040 00000100:00100000:2.0:1783951489.737362:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783951489.737370:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624263040:12345-0@lo:502: 00000100:00100000:2.0:1783951489.737539:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624263040:12345-0@lo:502: Request processed in 169us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.737556:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783951489.740164:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624263040:0@lo:502: 00000040:00080000:1.0:1783951489.740534:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783951489.740603:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783951489.740639:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783951489.740686:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783951489.740727:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783951489.740785:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783951489.740855:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783951489.740909:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783951489.740964:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783951489.741005:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783951489.741051:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783951489.741101:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783951489.741141:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783951489.741195:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783951489.741250:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783951489.741291:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783951489.741326:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783951489.741376:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783951489.741414:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783951489.741448:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783951489.741498:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783951489.741538:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783951489.741575:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1783951489.741624:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1783951489.741664:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1783951489.741700:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1783951489.741755:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1783951489.741795:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1783951489.741860:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624263168:0@lo:502: 00000100:00100000:1.0:1783951489.741949:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.741987:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951489.746244:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624263168 00000100:00100000:2.0:1783951489.746260:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624263168 00000100:00100000:2.0:1783951489.746351:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783951489.746361:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624263168:12345-0@lo:502: 00000100:00100000:2.0:1783951489.746640:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624263168:12345-0@lo:502: Request processed in 279us (4690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.746648:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951489.747250:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624263168:0@lo:502: 00000040:00080000:1.0:1783951489.747362:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1783951489.747377:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1783951489.749989:0:6611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783951489.750010:0:6611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e8d6053b380) 00000020:00000080:2.0:1783951489.750035:0:6611:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1783951489.750328:0:6611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8d604cd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783951489.750333:0:6611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8d604cd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783951489.750336:0:6611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d604cd800 3 00010000:00080000:2.0:1783951489.750366:0:6611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d7faaf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783951489.758052:0:6611:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1783951489.758194:0:6611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783951489.758239:0:6611:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783951489.758254:0:6611:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x443dabd358eec1e6 00000100:00080000:3.0:1783951489.758265:0:6611:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951489.758272:0:6611:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e8d7faaf800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783951489.758314:0:6611:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d7a08b100 x1870608624263296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951489.758343:0:6611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783951489.758673:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1870608624263296:0@lo:38: 00000100:00100000:2.0:1783951489.758751:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951489.758918:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624263424:0@lo:400: 00000100:00100000:2.0:1783951489.758943:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951489.758974:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624263296 00000100:00100000:2.0:1783951489.758981:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624263296 00000100:00100000:2.0:1783951489.759006:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624263424 00000100:00100000:2.0:1783951489.759009:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624263424 00000100:00100000:2.0:1783951489.759031:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951489.759039:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624263424:12345-0@lo:400: 00000100:00100000:2.0:1783951489.759089:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624263424:12345-0@lo:400: Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.759107:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951489.759122:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951489.759127:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1870608624263296:12345-0@lo:38: 00010000:00080000:2.0:1783951489.759147:0:5792:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1783951489.759174:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x443dabd358eec1ed 00000004:00100000:2.0:1783951489.759188:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951489.759215:0:5792:0:(import.c:65:import_set_state_nolock()) ffff8e8d7faab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951489.759252:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870608624263296:12345-0@lo:38: Request processed in 123us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.759258:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783951489.759292:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8d7a08b100 x1870608624263296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951489.759303:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783951489.759311:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783951489.759319:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783951489.759325:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783951489.759327:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d7faaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783951489.759333:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1870608624263296:0@lo:38: 00010000:00080000:2.0:1783951489.759363:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8d5855ea00 x1870608624263424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951489.759372:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624263424:0@lo:400: 00000040:00080000:1.0:1783951489.760083:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1783951489.760132:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1783951489.760156:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951489.761669:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.761686:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783951489.761747:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783951489.761749:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951489.761750:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951489.761751:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951489.761753:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951489.761755:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951489.761756:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951489.761758:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783951489.761759:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783951489.761761:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951489.761762:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951489.761766:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1783951489.761769:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951489.761770:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951489.761771:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951489.761772:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951489.761773:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951489.761774:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951489.761775:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951489.761776:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783951489.761777:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783951489.761778:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951489.761779:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951489.761806:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783951489.761839:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624263552:0@lo:253: 00000100:00100000:1.0:1783951489.761911:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.763670:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951489.768062:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624263552 00000100:00100000:3.0:1783951489.768078:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624263552 00000100:00100000:3.0:1783951489.768182:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783951489.768193:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6587:x1870608624263552:12345-0@lo:253: 20000000:01000000:3.0:1783951489.768225:0:5784:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783951489.768240:0:5784:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783951489.842146:0:5784:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783951489.842166:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783951489.843351:0:5807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783951489.843360:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783951489.843383:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.843415:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d41513600/0x443dabd358eec153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec14c expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.843424:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.843467:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d41513600/0x443dabd358eec153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec14c expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.843482:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d41513600/0x443dabd358eec153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec14c expref: 13 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951489.843500:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1870608624263680:0@lo:104: 00000100:00100000:0.0:1783951489.843586:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951489.843646:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951489.843851:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624263680 00000100:00100000:2.0:1783951489.843860:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624263680 00000100:00100000:2.0:1783951489.843915:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783951489.843924:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5807:x1870608624263680:12345-0@lo:104: 00010000:00010000:2.0:1783951489.843945:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951489.844003:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951489.844010:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5807:x1870608624263680:12345-0@lo:104: Request processed in 87us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.844017:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783951489.844165:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951489.844172:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844180:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951489.844185:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844204:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951489.844212:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951489.844218:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951489.844260:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec14c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844267:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951489.844287:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec14c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844294:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec14c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec153 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844313:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951489.844315:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951489.844317:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951489.844331:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624263808:0@lo:103: 00000100:00100000:1.0:1783951489.844368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951489.844424:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624263808 00000100:00100000:1.0:1783951489.844428:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624263808 00010000:00010000:1.0:1783951489.844446:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d41513600/0x443dabd358eec153 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec14c expref: 14 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951489.844468:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951489.844475:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:3312:x1870608624263808:12345-0@lo:103: 00010000:00010000:1.0:1783951489.844495:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951489.844500:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d41513600/0x443dabd358eec153 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec14c expref: 14 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844510:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d41513600/0x443dabd358eec153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec14c expref: 14 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844529:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844536:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783951489.844550:0:5777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001190163s 00010000:00010000:1.0:1783951489.844555:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844561:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844568:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844573:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844579:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40030e00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951489.844582:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844590:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844606:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951489.844615:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951489.844642:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:3312:x1870608624263808:12345-0@lo:103: Request processed in 168us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951489.844650:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951489.844717:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624263808:0@lo:103: 00010000:00010000:0.0:1783951489.845221:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41513600/0x443dabd358eec153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec14c expref: 13 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951489.845235:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1870608624263680:0@lo:104: 00010000:00010000:0.0:1783951489.845250:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.845259:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.845266:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951489.845271:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec1f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951489.853356:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:6587:x1870608624263552:12345-0@lo:253: Request processed in 85155us (91434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951489.853372:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783951489.853633:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6587:1870608624263552:0@lo:253: 10000000:01000000:1.0:1783951489.853650:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783951489.853653:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783951489.853655:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951489.853657:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951489.853658:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951489.853659:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951489.853660:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951489.853662:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951489.853663:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783951489.853665:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783951489.853666:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951489.853668:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783951489.853681:0:6587:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783951489.862752:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783951489.862992:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783951489.863226:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783951489.863393:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783951489.863625:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783951489.863937:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783951489.869047:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1783951490.172125:0:6587:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783951490.172135:0:6587:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783951490.172186:0:6587:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783951490.172268:0:6587:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783951490.172286:0:6587:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783951490.172318:0:6587:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1783951490.295168:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951491.318149:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951492.342922:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783951493.238487:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783951493.238502:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d4535a000 from 21 10000000:01000000:3.0:1783951493.238507:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783951493.238572:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951493.238584:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951493.238595:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951493.238618:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624263936:0@lo:101: 00000100:00100000:3.0:1783951493.238694:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951493.238739:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44ceea80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.238962:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624263936 00000100:00100000:2.0:1783951493.238970:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624263936 00000100:00100000:2.0:1783951493.239024:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783951493.239033:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624263936:12345-0@lo:101: 00010000:00010000:2.0:1783951493.239047:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951493.239061:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec1fb expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.239086:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec1fb expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.239096:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec1fb expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.239117:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:2.0:1783951493.239161:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624263936:12345-0@lo:101: Request processed in 129us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.239168:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783951493.239210:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624263936:0@lo:101: 00010000:00010000:2.0:1783951493.239225:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.239233:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951493.239281:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264064:0@lo:501: 00000100:00100000:2.0:1783951493.239317:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.239341:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5dd080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.239355:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624264064 00000100:00100000:2.0:1783951493.239358:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624264064 00000100:00100000:2.0:1783951493.239380:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951493.239385:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624264064:12345-0@lo:501: 00000100:00100000:2.0:1783951493.239757:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624264064:12345-0@lo:501: Request processed in 371us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.239765:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951493.239792:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264064:0@lo:501: 00000100:00100000:2.0:1783951493.239849:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264192:0@lo:503: 00000100:00100000:2.0:1783951493.239885:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.239898:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5dd080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.239915:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624264192 00000100:00100000:2.0:1783951493.239919:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624264192 00000100:00100000:2.0:1783951493.239936:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951493.239942:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624264192:12345-0@lo:503: 00000100:00100000:2.0:1783951493.240210:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624264192:12345-0@lo:503: Request processed in 267us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.240217:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951493.240252:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264192:0@lo:503: 00000100:00100000:2.0:1783951493.240435:0:6770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6770:1870608624264320:0@lo:502: 00000100:00100000:2.0:1783951493.240469:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.240487:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624264320 00000100:00100000:2.0:1783951493.240491:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624264320 00000100:00100000:2.0:1783951493.240512:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951493.240518:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6770:x1870608624264320:12345-0@lo:502: 00000100:00100000:2.0:1783951493.240711:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6770:x1870608624264320:12345-0@lo:502: Request processed in 192us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.240718:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951493.240746:0:6770:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5dd083c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.240759:0:6770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6770:1870608624264320:0@lo:502: 00000100:00100000:2.0:1783951493.240797:0:6770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6770:1870608624264448:0@lo:502: 00000100:00100000:2.0:1783951493.240862:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.240881:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624264448 00000100:00100000:2.0:1783951493.240885:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624264448 00000100:00100000:2.0:1783951493.240904:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783951493.240911:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6770:x1870608624264448:12345-0@lo:502: 00000100:00100000:2.0:1783951493.241026:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:6770:x1870608624264448:12345-0@lo:502: Request processed in 115us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.241039:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783951493.241066:0:6770:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d45293b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.241078:0:6770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6770:1870608624264448:0@lo:502: 00000040:00080000:2.0:1783951493.241096:0:6770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1783951493.241144:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1783951493.241158:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783951493.241166:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.241176:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951493.241185:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783951493.241188:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e8d4535a000 from 4 10000000:01000000:2.0:1783951493.241191:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951493.241215:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.241223:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.241232:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951493.241243:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264576:0@lo:101: 00000100:00100000:2.0:1783951493.241266:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.241277:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5dd089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.241287:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624264576 00000100:00100000:2.0:1783951493.241290:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624264576 00000100:00100000:2.0:1783951493.241313:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951493.241319:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624264576:12345-0@lo:101: 00010000:00010000:2.0:1783951493.241327:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951493.241338:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec209 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.241355:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec209 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.241364:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec209 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.241373:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f600, rc 0) 00000100:00100000:2.0:1783951493.241398:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624264576:12345-0@lo:101: Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.241404:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951493.241431:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264576:0@lo:101: 00010000:00010000:2.0:1783951493.241479:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.241488:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951493.241527:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264704:0@lo:256: 00000100:00100000:2.0:1783951493.241555:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.241567:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.241577:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624264704 00000100:00100000:2.0:1783951493.241580:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624264704 00000100:00100000:2.0:1783951493.241597:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951493.241608:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624264704:12345-0@lo:256: 20000000:01000000:2.0:1783951493.241620:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951493.241636:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951493.241639:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783951493.241708:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624264704:12345-0@lo:256: Request processed in 100us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.241716:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951493.241742:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264704:0@lo:256: 10000000:01000000:2.0:1783951493.241778:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951493.241783:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.241791:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951493.241798:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783951493.241800:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1783951493.241803:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783951493.243160:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.243177:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.243188:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951493.243211:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264832:0@lo:101: 00000100:00100000:2.0:1783951493.243257:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.243492:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951493.243947:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624264832 00000100:00100000:3.0:1783951493.243954:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624264832 00000100:00100000:3.0:1783951493.244037:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783951493.244047:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624264832:12345-0@lo:101: 00010000:00010000:3.0:1783951493.244061:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951493.244076:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec217 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951493.244104:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec217 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951493.244115:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec217 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951493.244125:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d41513600, rc 0) 00000100:00100000:3.0:1783951493.244174:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624264832:12345-0@lo:101: Request processed in 129us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951493.244190:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783951493.245155:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264832:0@lo:101: 00010000:00010000:2.0:1783951493.245175:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.245186:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951493.245249:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264960:0@lo:501: 00000100:00100000:2.0:1783951493.245288:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.245460:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951493.245746:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624264960 00000100:00100000:1.0:1783951493.245753:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624264960 00000100:00100000:1.0:1783951493.245796:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783951493.245805:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624264960:12345-0@lo:501: 00000100:00100000:1.0:1783951493.246158:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624264960:12345-0@lo:501: Request processed in 353us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951493.246166:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951493.247767:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624264960:0@lo:501: 00000100:00100000:2.0:1783951493.247868:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624265088:0@lo:503: 00000100:00100000:2.0:1783951493.247949:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.247987:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951493.249059:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624265088 00000100:00100000:1.0:1783951493.249069:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624265088 00000100:00100000:1.0:1783951493.249127:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783951493.249137:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624265088:12345-0@lo:503: 00000100:00100000:1.0:1783951493.251231:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624265088:12345-0@lo:503: Request processed in 2088us (3275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951493.252027:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624265088:0@lo:503: 00000100:00100000:1.0:1783951493.252795:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783951493.253625:0:6772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6772:1870608624265216:0@lo:502: 00000100:00100000:3.0:1783951493.253768:0:6772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951493.253844:0:6772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44ceea80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.254034:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624265216 00000100:00100000:2.0:1783951493.254044:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624265216 00000100:00100000:2.0:1783951493.254098:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951493.254108:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60acc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:6772:x1870608624265216:12345-0@lo:502: 00000100:00100000:2.0:1783951493.255034:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60acc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:6772:x1870608624265216:12345-0@lo:502: Request processed in 924us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.255044:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783951493.255452:0:6772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6772:1870608624265216:0@lo:502: 00000020:01000000:3.0:1783951493.255489:0:6772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951493.255498:0:6772:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783951493.255507:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951493.255510:0:6772:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783951493.255592:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783951493.255597:0:6772:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1783951493.255620:0:6772:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783951493.255623:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951493.255755:0:6772:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e8d7f850000) 00000020:00000080:3.0:1783951493.255778:0:6772:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1783951493.255786:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783951493.255923:0:6772:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783951493.255929:0:6772:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783951493.255936:0:6772:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eec22c 00010000:00080000:3.0:1783951493.255966:0:6772:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d601c1000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783951493.256199:0:6772:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:0.0:1783951493.372001:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783951493.397315:0:6772:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783951493.397349:0:6772:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783951493.397940:0:6772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951493.398409:0:6772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951493.398466:0:6772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1783951493.398668:0:6772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783951493.399295:0:6776:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951493.399301:0:6776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783951493.400545:0:6772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951493.400560:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783951493.400609:0:6772:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783951493.400634:0:6772:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eec233 00000100:00080000:2.0:1783951493.400646:0:6772:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951493.400652:0:6772:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8d601c1000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951493.400692:0:6772:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d5855ca80 x1870608624265344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951493.400725:0:6772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783951493.400795:0:6772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951493.400800:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951493.400802:0:6772:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783951493.400805:0:6772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951493.400842:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951493.400844:0:6772:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783951493.400849:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783951493.400850:0:6772:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783951493.400880:0:6772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6772:1870608624265472:0@lo:502: 00000100:00100000:2.0:1783951493.400979:0:6772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.401048:0:6772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.401089:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624265472 00000100:00100000:2.0:1783951493.401095:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624265472 00000100:00100000:2.0:1783951493.401133:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951493.401142:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:6772:x1870608624265472:12345-0@lo:502: 00000100:00100000:2.0:1783951493.401368:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:6772:x1870608624265472:12345-0@lo:502: Request processed in 225us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.401376:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951493.401432:0:6772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:6772:1870608624265472:0@lo:502: 00000020:01000000:2.0:1783951493.401458:0:6772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951493.401469:0:6772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951493.401471:0:6772:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783951493.401476:0:6772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1783951493.401599:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1783951493.401620:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783951493.401632:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.401643:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951493.401655:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783951493.401658:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8d585e0000 from 1 10000000:01000000:2.0:1783951493.401662:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783951493.401690:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.401699:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.401710:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951493.401725:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624265600:0@lo:101: 00000100:00100000:2.0:1783951493.401755:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.401771:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.401787:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624265600 00000100:00100000:2.0:1783951493.401791:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624265600 00000100:00100000:2.0:1783951493.401848:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951493.401856:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d50470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624265600:12345-0@lo:101: 00010000:00010000:2.0:1783951493.401865:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951493.401889:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec23a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.401918:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec23a expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.401932:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec23a expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.401943:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f800, rc 0) 00000100:00100000:2.0:1783951493.401974:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d50470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624265600:12345-0@lo:101: Request processed in 120us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.401980:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951493.402012:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624265600:0@lo:101: 00010000:00010000:2.0:1783951493.402025:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.402035:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951493.402078:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624265728:0@lo:501: 00000100:00100000:2.0:1783951493.402101:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.402114:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.402125:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624265728 00000100:00100000:2.0:1783951493.402128:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624265728 00000100:00100000:2.0:1783951493.402145:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783951493.402151:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d50473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624265728:12345-0@lo:501: 00000100:00100000:2.0:1783951493.402344:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d50473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624265728:12345-0@lo:501: Request processed in 192us (241us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951493.402360:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783951493.402400:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624265728:0@lo:501: 10000000:01000000:2.0:1783951493.402418:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783951493.402424:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951493.402431:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951493.402888:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951493.402903:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624265856:0@lo:400: 00000100:00100000:3.0:1783951493.402948:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951493.402998:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624265984:0@lo:400: 00000100:00100000:3.0:1783951493.403027:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951493.403102:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624265856 00000100:00100000:3.0:1783951493.403107:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624265856 00000100:00100000:3.0:1783951493.403140:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624265984 00000100:00100000:3.0:1783951493.403142:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624265984 00000100:00100000:3.0:1783951493.403167:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951493.403173:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624265856:12345-0@lo:400: 00000100:00100000:3.0:1783951493.403216:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624265856:12345-0@lo:400: Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951493.403222:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951493.403234:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951493.403240:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624265984:12345-0@lo:400: 00000100:00100000:3.0:1783951493.403267:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624265984:12345-0@lo:400: Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951493.403273:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783951493.403748:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783951493.403783:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7a08aa00 x1870608624265984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951493.403797:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624265984:0@lo:400: 00010000:00080000:3.0:1783951493.403867:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7a08b800 x1870608624265856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951493.403876:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624265856:0@lo:400: 00000100:00100000:0.0:1783951493.403894:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624265344:0@lo:8: 00000100:00100000:0.0:1783951493.403938:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.404016:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624265344 00000100:00100000:2.0:1783951493.404022:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624265344 00000100:00100000:2.0:1783951493.404054:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951493.404059:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1870608624265344:12345-0@lo:8: 00010000:00080000:2.0:1783951493.404174:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1783951493.404207:0:6589:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eec248 00002000:00100000:2.0:1783951493.404247:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e8d80e96800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783951493.404252:0:6589:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1783951493.404256:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783951493.404396:0:6589:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783951493.404536:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783951493.404561:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8d80e94800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951493.404624:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1870608624265344:12345-0@lo:8: Request processed in 564us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.404631:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783951493.404732:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d5855ca80 x1870608624265344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951493.404741:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951493.404749:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783951493.404755:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783951493.404762:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783951493.404764:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d601c1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783951493.404788:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783951493.404793:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624265344:0@lo:8: 00000004:00080000:2.0:1783951493.405565:0:6776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783951493.405716:0:6776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 210310905563ns, next at 0ns, rc = 0 00000004:00080000:0.0:1783951493.488153:0:6777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783951493.488186:0:6777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6777:1870608624266240:0@lo:7: 00000100:00100000:0.0:1783951493.488255:0:6777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951493.488311:0:6777:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951493.489692:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624266112:0@lo:13: 00000100:00100000:3.0:1783951493.489761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951493.493012:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624266112 00000100:00100000:0.0:1783951493.493030:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624266112 00000100:00100000:0.0:1783951493.493112:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951493.493124:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624266112:12345-0@lo:13: 00002000:00000024:0.0:1783951493.493172:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1783951493.493261:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624266112:12345-0@lo:13: Request processed in 141us (3500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951493.493268:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951493.495041:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624266240 00000100:00100000:2.0:1783951493.495055:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624266240 00000100:00100000:2.0:1783951493.495107:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951493.495128:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6777:x1870608624266240:12345-0@lo:7: 00000100:00080000:3.0:1783951493.499485:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783951493.499547:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d74fc3800 x1870608624266112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951493.499589:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624266112:0@lo:13: 00002000:00080000:2.0:1783951493.506294:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783951493.506303:0:6591:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783951493.507654:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6777:x1870608624266240:12345-0@lo:7: Request processed in 12527us (19387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951493.507670:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783951493.507769:0:6777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d74fc2a00 x1870608624266240/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783951509 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951493.507786:0:6777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6777:1870608624266240:0@lo:7: 00000004:00080000:2.0:1783951493.507801:0:6777:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783951493.507903:0:6777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6777:1870608624266368:0@lo:5: 00000100:00100000:2.0:1783951493.507945:0:6777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.507991:0:6777:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951493.508052:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624266368 00000100:00100000:0.0:1783951493.508059:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624266368 00000100:00100000:0.0:1783951493.508109:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951493.508118:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6777:x1870608624266368:12345-0@lo:5: 00002000:00080000:0.0:1783951493.508144:0:6589:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783951493.508148:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783951493.508469:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6777:x1870608624266368:12345-0@lo:5: Request processed in 351us (523us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783951493.508475:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783951493.510983:0:6777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d5855d180 x1870608624266368/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951509 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951493.511015:0:6777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6777:1870608624266368:0@lo:5: 00000004:00080000:2.0:1783951493.511029:0:6777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783951493.511076:0:6777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6777:1870608624266496:0@lo:700: 00000100:00100000:2.0:1783951493.511128:0:6777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.511182:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624266496 00000100:00100000:2.0:1783951493.511188:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624266496 00000100:00100000:2.0:1783951493.511235:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951493.511244:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6777:x1870608624266496:12345-0@lo:700: 00000100:00100000:2.0:1783951493.511289:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6598:1870608624266624:0@lo:700: 00000100:00100000:2.0:1783951493.511320:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.511847:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951493.511896:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624266624 00000100:00100000:2.0:1783951493.511901:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624266624 00000100:00100000:2.0:1783951493.511937:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951493.511945:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6598:x1870608624266624:12345-0@lo:700: 00000100:00100000:2.0:1783951493.513978:0:6777:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4780 going to sleep for 11 seconds 00000004:00080000:0.0:1783951493.575290:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1783951493.624399:0:5798:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1783951493.630627:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6598:x1870608624266624:12345-0@lo:700: Request processed in 118672us (119295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951493.630649:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783951493.630739:0:6598:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d5855ed80 x1870608624266624/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783951509 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951493.630756:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6598:1870608624266624:0@lo:700: 40000000:02000000:0.0:1783951493.630771:0:6598:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1783951493.708746:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1783951493.708776:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783951493.709156:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6777:x1870608624266496:12345-0@lo:700: Request processed in 197909us (198023us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951493.709174:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783951493.709252:0:6777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d5855f480 x1870608624266496/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783951509 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951493.709265:0:6777:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783951493.709283:0:6777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6777:1870608624266496:0@lo:700: 00000004:02000040:2.0:1783951493.738692:0:6777:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1783951493.748645:0:6777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6777:1870608624266752:0@lo:5: 00000100:00100000:2.0:1783951493.748731:0:6777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951493.748786:0:6777:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71dd19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951493.748860:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624266752 00000100:00100000:1.0:1783951493.748869:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624266752 00000100:00100000:1.0:1783951493.748929:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951493.748940:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6777:x1870608624266752:12345-0@lo:5: 00002000:00080000:1.0:1783951493.754918:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1783951493.754938:0:6591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1783951493.763862:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6777:x1870608624266752:12345-0@lo:5: Request processed in 14916us (15122us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783951493.763876:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783951493.766004:0:6777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d5855f480 x1870608624266752/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951509 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951493.766031:0:6777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6777:1870608624266752:0@lo:5: 00000004:00080000:3.0:1783951493.766049:0:6777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1783951494.390049:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951495.413968:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951496.437965:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951496.492164:0:6959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783951497.463099:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951498.485965:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951498.614223:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624266880:0@lo:13: 00000100:00100000:3.0:1783951498.614311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951498.614427:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624266880 00000100:00100000:0.0:1783951498.614437:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624266880 00000100:00100000:0.0:1783951498.614504:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951498.614529:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624266880:12345-0@lo:13: 00002000:00000024:0.0:1783951498.614575:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951498.614623:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624266880:12345-0@lo:13: Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951498.614631:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951498.614669:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624267008:0@lo:400: 00000100:00100000:1.0:1783951498.614684:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624267264:0@lo:400: 00000100:00100000:0.0:1783951498.614703:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783951498.614775:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d74fc0a80 x1870608624266880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951498.614807:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624266880:0@lo:13: 00000100:00100000:2.0:1783951498.614933:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624267008 00000100:00100000:2.0:1783951498.614939:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624267008 00000100:00100000:2.0:1783951498.614971:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1783951498.615446:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951498.615463:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624267136:0@lo:400: 00000100:00100000:2.0:1783951498.615490:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:3313:x1870608624267008:12345-0@lo:400: 00000100:00100000:1.0:1783951498.617165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951498.617244:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624267264 00000100:00100000:0.0:1783951498.617255:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624267264 00000100:00080000:1.0:1783951498.617304:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951498.617340:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951498.617355:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624267264:12345-0@lo:400: 00000100:00100000:0.0:1783951498.617426:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624267264:12345-0@lo:400: Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951498.617435:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783951498.619313:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7a1c8000 x1870608624267264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951498.619334:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624267264:0@lo:400: 00000100:00100000:3.0:1783951498.619831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951498.620047:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624267136 00000100:00100000:0.0:1783951498.620055:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624267136 00000100:00100000:0.0:1783951498.620107:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783951498.620117:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624267136:12345-0@lo:400: 00000100:00100000:0.0:1783951498.620323:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624267136:12345-0@lo:400: Request processed in 208us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951498.620332:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783951498.620401:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7a1ca680 x1870608624267136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951498.620413:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624267136:0@lo:400: 00000100:00100000:2.0:1783951498.620761:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:3313:x1870608624267008:12345-0@lo:400: Request processed in 5782us (6057us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951498.620772:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783951498.621115:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624267008:0@lo:400: 00000001:00080000:0.0:1783951499.195858:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1783951499.516481:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951500.534065:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951501.560324:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951502.606265:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951503.611855:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951503.734464:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624267520:0@lo:400: 00000100:00100000:3.0:1783951503.734535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951503.734590:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951503.734596:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624267392:0@lo:400: 00000100:00100000:3.0:1783951503.734623:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951503.734664:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624267648:0@lo:400: 00000100:00100000:3.0:1783951503.734698:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951503.734719:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951503.734724:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624267776:0@lo:400: 00000100:00100000:3.0:1783951503.734748:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951503.734786:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624267520 00000100:00100000:3.0:1783951503.734796:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624267520 00000100:00100000:3.0:1783951503.734871:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624267648 00000100:00100000:3.0:1783951503.734875:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624267648 00000100:00100000:3.0:1783951503.734908:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951503.734918:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624267520:12345-0@lo:400: 00000100:00100000:3.0:1783951503.734974:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624267520:12345-0@lo:400: Request processed in 57us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951503.734982:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951503.734998:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951503.735003:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624267648:12345-0@lo:400: 00000100:00100000:3.0:1783951503.735033:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624267648:12345-0@lo:400: Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951503.735038:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951503.735057:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624267392 00000100:00100000:3.0:1783951503.735060:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624267392 00000100:00100000:3.0:1783951503.735083:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783951503.735089:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:3313:x1870608624267392:12345-0@lo:400: 00000100:00100000:3.0:1783951503.735116:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:3313:x1870608624267392:12345-0@lo:400: Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951503.735122:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1783951503.735155:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783951503.735187:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7a088000 x1870608624267648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951503.735206:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624267648:0@lo:400: 00000100:00100000:3.0:1783951503.735233:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624267392:0@lo:400: 00010000:00080000:3.0:1783951503.735244:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7a08b480 x1870608624267520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951503.735253:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624267520:0@lo:400: 00000100:00100000:3.0:1783951503.736554:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624267776 00000100:00100000:3.0:1783951503.736566:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624267776 00000100:00100000:3.0:1783951503.736619:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951503.736628:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624267776:12345-0@lo:400: 00000100:00100000:3.0:1783951503.736706:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624267776:12345-0@lo:400: Request processed in 80us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951503.736714:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783951503.736737:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783951503.736766:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7a08a680 x1870608624267776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951503.736779:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783951503.736795:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624267776:0@lo:400: 00000100:00100000:0.0:1783951503.738411:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624267904:0@lo:13: 00000100:00100000:0.0:1783951503.738473:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951503.738700:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624267904 00000100:00100000:2.0:1783951503.738709:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624267904 00000100:00100000:2.0:1783951503.738790:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951503.738800:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624267904:12345-0@lo:13: 00002000:00000024:2.0:1783951503.738860:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951503.738905:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624267904:12345-0@lo:13: Request processed in 106us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951503.738913:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783951503.739060:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7a1c8000 x1870608624267904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951503.739078:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624267904:0@lo:13: 00010000:00010000:3.0:1783951504.648310:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951505.654209:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951506.681164:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783951506.950888:0:7485:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783951506.950898:0:7485:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1783951506.951047:0:7485:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8d7a084000 00000020:01000004:0.0:1783951506.951064:0:7485:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1783951506.951078:0:7485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1783951506.951101:0:7485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e8d81664d40) 00000020:00000080:0.0:1783951506.951121:0:7485:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783951506.970084:0:7485:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783951506.971241:0:7485:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783951507.002988:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783951507.009620:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783951507.009659:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783951507.009721:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783951507.009762:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783951507.011086:0:7485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783951507.011211:0:7485:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783951507.011224:0:7485:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x443dabd358eec256 00000020:01000004:3.0:1783951507.011233:0:7485:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783951507.011255:0:7485:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783951507.011259:0:7485:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783951507.011265:0:7485:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783951507.011290:0:7485:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783951507.011295:0:7485:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783951507.039364:0:7485:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783951507.039403:0:7485:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1783951507.039408:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783951507.039410:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783951507.039412:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951507.039413:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951507.039414:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951507.039416:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951507.039417:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951507.039419:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783951507.039420:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783951507.039422:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951507.039423:0:7485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783951507.039427:0:7485:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1783951507.039430:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783951507.039431:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783951507.039432:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951507.039433:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951507.039434:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951507.039435:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951507.039436:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951507.039437:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783951507.039438:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783951507.039445:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951507.039446:0:7485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783951507.039475:0:7485:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783951507.039495:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624268032:0@lo:253: 00000100:00100000:2.0:1783951507.039572:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.039700:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.039800:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624268032 00000100:00100000:0.0:1783951507.039872:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624268032 00000100:00100000:0.0:1783951507.039978:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783951507.039989:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:7485:x1870608624268032:12345-0@lo:253: 20000000:01000000:0.0:1783951507.040018:0:5784:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783951507.040022:0:5784:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1783951507.040028:0:5784:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1783951507.040032:0:5784:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1783951507.041187:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951507.041389:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1783951507.041406:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1783951507.041450:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1783951507.041458:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1783951507.041491:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1783951507.041566:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1783951507.041985:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1783951507.042005:0:5784:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:0.0:1783951507.042008:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1783951507.042044:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1783951507.042052:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783951507.042289:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1783951507.042299:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1783951507.042338:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1783951507.042348:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783951507.042379:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1783951507.042455:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1783951507.043612:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1783951507.043637:0:5784:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:1.0:1783951507.043639:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:1.0:1783951507.043679:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1783951507.043687:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783951507.043725:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1783951507.043734:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:1.0:1783951507.043765:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1783951507.043774:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783951507.045251:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1783951507.045358:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1783951507.045385:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1783951507.045388:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1783951507.045396:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783951507.045397:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783951507.045399:0:5784:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783951507.045413:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783951507.045415:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783951507.045466:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783951507.045469:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783951507.051842:0:7487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1783951507.051950:0:7487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1783951507.052013:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1783951507.052899:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1783951507.052952:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1783951507.053021:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1783951507.053034:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783951507.053037:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783951507.054682:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1783951507.055432:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1783951507.055489:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1783951507.055582:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1783951507.055608:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783951507.055611:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783951507.056781:0:7489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1783951507.059512:0:7489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1783951507.059565:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1783951507.061047:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1783951507.061236:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1783951507.061331:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1783951507.061350:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783951507.061353:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783951507.061975:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1783951507.062031:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1783951507.062084:0:7490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1783951507.062553:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1783951507.062613:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1783951507.062667:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1783951507.062688:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783951507.062709:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.062731:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.062739:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.062754:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec1fb expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.062759:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec217 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.062766:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec23a expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.062773:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.063002:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec23a expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.063018:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec23a expref: 16 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.063041:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268160:0@lo:104: 00000100:00100000:1.0:1783951507.063136:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951507.063194:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec217 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.063202:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec217 expref: 16 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.063209:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268288:0@lo:104: 00010000:00010000:1.0:1783951507.063234:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec1fb expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.063241:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec1fb expref: 16 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.063250:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268416:0@lo:104: 00010000:00010000:1.0:1783951507.063274:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.063282:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 16 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.063290:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268544:0@lo:104: 00010000:00010000:1.0:1783951507.063312:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.063320:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 16 pid: 5785 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.063340:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268672:0@lo:104: 00000100:00100000:1.0:1783951507.063362:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81563900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951507.063495:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783951507.063517:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.063548:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.063557:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.063564:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.063575:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624268160 00000100:00100000:2.0:1783951507.063582:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624268160 00000100:00100000:2.0:1783951507.063628:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624268288 00000100:00100000:2.0:1783951507.063631:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624268288 00000100:00100000:2.0:1783951507.063642:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624268416 00000100:00100000:2.0:1783951507.063645:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624268416 00000100:00100000:2.0:1783951507.063654:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624268544 00000100:00100000:2.0:1783951507.063656:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624268544 00000100:00100000:2.0:1783951507.063665:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624268672 00000100:00100000:2.0:1783951507.063667:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624268672 00000100:00100000:2.0:1783951507.063678:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951507.063686:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+7:5784:x1870608624268160:12345-0@lo:104: 00010000:00010000:2.0:1783951507.063715:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.063781:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951507.063788:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+7:5784:x1870608624268160:12345-0@lo:104: Request processed in 103us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.063795:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951507.063875:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951507.063881:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+6:5784:x1870608624268288:12345-0@lo:104: 00010000:00010000:2.0:1783951507.063888:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.063920:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783951507.063925:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+6:5784:x1870608624268288:12345-0@lo:104: Request processed in 45us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.063931:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951507.063947:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783951507.063952:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:5784:x1870608624268416:12345-0@lo:104: 00010000:00010000:2.0:1783951507.063959:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.063983:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783951507.063988:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:5784:x1870608624268416:12345-0@lo:104: Request processed in 37us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.063993:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783951507.064003:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951507.064007:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:5784:x1870608624268544:12345-0@lo:104: 00010000:00010000:2.0:1783951507.064020:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064043:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783951507.064047:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:5784:x1870608624268544:12345-0@lo:104: Request processed in 40us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.064052:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951507.064062:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951507.064067:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5784:x1870608624268672:12345-0@lo:104: 00010000:00010000:2.0:1783951507.064073:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064093:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1783951507.064097:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5784:x1870608624268672:12345-0@lo:104: Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.064102:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1783951507.064129:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783951507.064134:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064141:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fc00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951507.064145:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064154:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951507.064161:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951507.064173:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951507.064204:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064211:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951507.064229:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064236:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d4165fc00/0x443dabd358eec23a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec241 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064247:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783951507.064250:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064255:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951507.064258:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064264:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951507.064269:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951507.064274:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951507.064285:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064291:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951507.064312:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064318:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec21e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064329:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951507.064332:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064337:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41512000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951507.064340:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064347:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951507.064352:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951507.064357:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951507.064369:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064375:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951507.064379:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064385:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec1fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec202 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064395:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951507.064403:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064409:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5fc00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951507.064412:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064419:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951507.064424:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951507.064429:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951507.064443:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064448:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951507.064453:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064460:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec1d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064471:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951507.064474:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064480:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5f800 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951507.064483:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064500:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951507.064506:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951507.064512:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951507.064525:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064531:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951507.064536:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064542:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f800/0x443dabd358eec1a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1ae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.064556:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951507.064557:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951507.064559:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951507.064566:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951507.064586:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624268800:0@lo:103: 00000100:00100000:2.0:1783951507.064633:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.064664:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624269312:0@lo:103: 00000100:00100000:2.0:1783951507.064698:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.064720:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951507.064726:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624269184:0@lo:103: 00000100:00100000:2.0:1783951507.064747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.064784:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624268928:0@lo:103: 00000100:00100000:2.0:1783951507.064805:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.064850:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951507.064855:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624269056:0@lo:103: 00000100:00100000:2.0:1783951507.064873:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.064901:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624268800 00000100:00100000:2.0:1783951507.064905:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624268800 00010000:00010000:2.0:1783951507.064923:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec23a expref: 17 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.064936:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624269312 00000100:00100000:2.0:1783951507.064938:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624269312 00010000:00010000:2.0:1783951507.064945:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 18 pid: 5785 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.064953:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624269184 00000100:00100000:2.0:1783951507.064955:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624269184 00010000:00010000:2.0:1783951507.064962:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 19 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.064970:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624268928 00000100:00100000:2.0:1783951507.064972:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624268928 00010000:00010000:2.0:1783951507.064979:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec217 expref: 20 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.064987:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624269056 00000100:00100000:2.0:1783951507.064988:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624269056 00010000:00010000:2.0:1783951507.064996:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec1fb expref: 21 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.065005:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951507.065011:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+21:3313:x1870608624268800:12345-0@lo:103: 00010000:00010000:2.0:1783951507.065232:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951507.065239:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec23a expref: 21 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065251:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec23a expref: 21 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065271:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951507.065304:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+21:3313:x1870608624268800:12345-0@lo:103: Request processed in 293us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.065311:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951507.065327:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951507.065334:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:3313:x1870608624269312:12345-0@lo:103: 00010000:00010000:2.0:1783951507.065341:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951507.065345:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 20 pid: 5785 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065353:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 20 pid: 5785 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065362:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951507.065384:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:3313:x1870608624269312:12345-0@lo:103: Request processed in 52us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.065391:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951507.065402:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783951507.065408:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624269184:12345-0@lo:103: 00010000:00010000:2.0:1783951507.065417:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951507.065421:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 19 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065435:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 19 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065446:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951507.065469:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624269184:12345-0@lo:103: Request processed in 62us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.065475:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783951507.065488:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951507.065494:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3314:x1870608624268928:12345-0@lo:103: 00010000:00010000:2.0:1783951507.065501:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951507.065505:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec217 expref: 18 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065514:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec217 expref: 18 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065522:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951507.065547:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3314:x1870608624268928:12345-0@lo:103: Request processed in 53us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.065553:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951507.065565:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951507.065570:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:3314:x1870608624269056:12345-0@lo:103: 00010000:00010000:2.0:1783951507.065578:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951507.065582:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec1fb expref: 17 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065590:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec1fb expref: 17 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065621:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065628:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065641:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065648:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065653:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065659:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065665:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951507.065668:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065676:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065684:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.065693:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951507.065716:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:3314:x1870608624269056:12345-0@lo:103: Request processed in 146us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.065731:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951507.065784:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624269056:0@lo:103: 00000100:00100000:2.0:1783951507.065794:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624268928:0@lo:103: 00000100:00100000:2.0:1783951507.065847:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624269184:0@lo:103: 00000100:00100000:2.0:1783951507.065854:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624268800:0@lo:103: 00000100:00100000:2.0:1783951507.065861:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624269312:0@lo:103: 00010000:00010000:1.0:1783951507.066096:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec23a expref: 16 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.066118:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268160:0@lo:104: 00010000:00010000:1.0:1783951507.066129:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41513600/0x443dabd358eec21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec217 expref: 15 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.066136:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268288:0@lo:104: 00010000:00010000:1.0:1783951507.066143:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec1fb expref: 14 pid: 5786 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.066150:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268416:0@lo:104: 00010000:00010000:1.0:1783951507.066158:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41513400/0x443dabd358eec1d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec1d1 expref: 13 pid: 5784 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.066165:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268544:0@lo:104: 00010000:00010000:1.0:1783951507.066174:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec1a7 expref: 12 pid: 5785 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.066181:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1870608624268672:0@lo:104: 00010000:00010000:1.0:1783951507.066205:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.066212:0:5784:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.066224:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.066228:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec25d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783951507.066241:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783951507.126303:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:7485:x1870608624268032:12345-0@lo:253: Request processed in 86305us (86719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.126319:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783951507.126420:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624268032:0@lo:253: 10000000:01000000:0.0:1783951507.126436:0:7485:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783951507.126439:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951507.126441:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951507.126442:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951507.126444:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1783951507.126445:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951507.126446:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951507.126447:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951507.126449:0:7485:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783951507.126450:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951507.126452:0:7485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783951507.126473:0:7485:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8d7a084000 from lustre-OST0001 10000000:01000000:0.0:1783951507.126506:0:7485:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783951507.126509:0:7485:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783951507.126516:0:7485:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8d585e0000 local copy 10000000:01000000:0.0:1783951507.126520:0:7485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783951507.126555:0:7485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.126564:0:7485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.126573:0:7485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951507.126589:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624269440:0@lo:101: 00000100:00100000:0.0:1783951507.126635:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951507.126720:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44cee300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951507.127220:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624269440 00000100:00100000:3.0:1783951507.127228:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624269440 00000100:00100000:3.0:1783951507.127317:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783951507.127328:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+11:7485:x1870608624269440:12345-0@lo:101: 00010000:00010000:3.0:1783951507.127342:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951507.127357:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec26b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec264 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951507.127383:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec264 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951507.127393:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec264 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951507.127401:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9e00, rc 0) 00000100:00100000:3.0:1783951507.127452:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624269440:12345-0@lo:101: Request processed in 127us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951507.127457:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783951507.127534:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624269440:0@lo:101: 00010000:00010000:2.0:1783951507.127549:0:7485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.127558:0:7485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.127681:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624269568:0@lo:501: 00000100:00100000:2.0:1783951507.127710:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.127836:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.127958:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624269568 00000100:00100000:0.0:1783951507.127963:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624269568 00000100:00100000:0.0:1783951507.127986:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783951507.127993:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624269568:12345-0@lo:501: 00000100:00100000:0.0:1783951507.128311:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624269568:12345-0@lo:501: Request processed in 316us (599us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951507.128318:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783951507.128451:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624269568:0@lo:501: 10000000:01000000:2.0:1783951507.128465:0:7485:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783951507.128494:0:7485:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783951507.128501:0:7485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.128516:0:7485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.128523:0:7485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.128547:0:7485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783951507.128567:0:7485:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8d7a084000 10000000:01000000:2.0:1783951507.128572:0:7485:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783951507.128577:0:7485:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783951507.128580:0:7485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951507.128584:0:7485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783951507.128586:0:7485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783951507.128615:0:7485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.128622:0:7485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.128630:0:7485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.128644:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624269696:0@lo:101: 00000100:00100000:2.0:1783951507.128672:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.128691:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1783951507.128745:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951507.128750:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.128757:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40031800 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951507.128761:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.128769:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951507.128775:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951507.128781:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951507.129669:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.129678:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951507.129712:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.129720:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x443dabd358eec26b expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.129740:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951507.129742:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951507.129754:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951507.129772:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624269696 00000100:00100000:0.0:1783951507.129778:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624269696 00000100:00100000:0.0:1783951507.129838:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951507.129849:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624269696:12345-0@lo:101: 00010000:00010000:0.0:1783951507.129859:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951507.129874:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec272 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.129896:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec272 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.129907:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec272 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.129916:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d40030e00, rc 0) 00000100:00100000:0.0:1783951507.129967:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624269696:12345-0@lo:101: Request processed in 120us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.129973:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783951507.130227:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624269824:0@lo:103: 00000100:00100000:2.0:1783951507.130262:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.130340:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624269696:0@lo:101: 00010000:00010000:2.0:1783951507.130361:0:7485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.130371:0:7485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.130461:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624269952:0@lo:501: 00000100:00100000:2.0:1783951507.130486:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.130508:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951507.130571:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624269824 00000100:00100000:3.0:1783951507.130582:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624269824 00000100:00100000:3.0:1783951507.130633:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951507.130641:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:3314:x1870608624269824:12345-0@lo:103: 00010000:00010000:3.0:1783951507.130651:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951507.130663:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec26b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec264 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951507.130675:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951507.130708:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:3314:x1870608624269824:12345-0@lo:103: Request processed in 68us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951507.130714:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951507.130741:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624269824:0@lo:103: 00000100:00100000:0.0:1783951507.130794:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624269952 00000100:00100000:0.0:1783951507.130799:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624269952 00000100:00100000:0.0:1783951507.130858:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783951507.130865:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624269952:12345-0@lo:501: 00000100:00100000:0.0:1783951507.131086:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624269952:12345-0@lo:501: Request processed in 221us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.131092:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783951507.131344:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624269952:0@lo:501: 00000100:00100000:2.0:1783951507.131374:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270080:0@lo:503: 00000100:00100000:2.0:1783951507.131413:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.131445:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.131495:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624270080 00000100:00100000:0.0:1783951507.131500:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624270080 00000100:00100000:0.0:1783951507.131530:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783951507.131546:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624270080:12345-0@lo:503: 00000100:00100000:0.0:1783951507.131707:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624270080:12345-0@lo:503: Request processed in 162us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.131713:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783951507.131799:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270080:0@lo:503: 00000040:00080000:2.0:1783951507.132066:0:7485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951507.132325:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270208:0@lo:502: 00000100:00100000:3.0:1783951507.132365:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951507.132383:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.133661:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624270208 00000100:00100000:0.0:1783951507.133672:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624270208 00000100:00100000:0.0:1783951507.133770:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783951507.133780:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624270208:12345-0@lo:502: 00000100:00100000:0.0:1783951507.134037:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624270208:12345-0@lo:502: Request processed in 257us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.134045:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783951507.134345:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270208:0@lo:502: 00000040:00080000:3.0:1783951507.134677:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783951507.134743:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783951507.134787:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783951507.134858:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783951507.134898:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783951507.134937:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783951507.134973:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270336:0@lo:502: 00000100:00100000:3.0:1783951507.135024:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951507.135241:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624270336 00000100:00100000:0.0:1783951507.135247:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624270336 00000100:00100000:0.0:1783951507.135276:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951507.135284:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624270336:12345-0@lo:502: 00000100:00100000:0.0:1783951507.135556:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624270336:12345-0@lo:502: Request processed in 273us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.135563:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783951507.135737:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951507.135757:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270336:0@lo:502: 00000040:00080000:3.0:1783951507.135891:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783951507.135910:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1783951507.136642:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951507.136650:0:7493:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1783951507.136657:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951507.136659:0:7493:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783951507.136665:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951507.136680:0:7493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e8d7f8519c0) 00000020:00000080:3.0:1783951507.136702:0:7493:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783951507.136708:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783951507.136771:0:7493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8d7a084000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783951507.136779:0:7493:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783951507.136786:0:7493:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x443dabd358eec287 00010000:00010000:3.0:1783951507.140641:0:7493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1783951507.142666:0:7493:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1783951507.146035:0:7493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783951507.146513:0:7493:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1783951507.151314:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1783951507.151907:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1783951507.157618:0:7493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783951507.157632:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951507.157639:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951507.157642:0:7493:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783951507.157646:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951507.157651:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951507.157652:0:7493:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783951507.157656:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783951507.157657:0:7493:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783951507.157715:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951507.157716:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951507.157717:0:7493:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783951507.157720:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783951507.160641:0:7485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1783951507.160684:0:7485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783951507.160698:0:7485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.160710:0:7485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951507.160729:0:7485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d7a084000 from 1 10000000:01000000:0.0:1783951507.160731:0:7485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951507.160766:0:7485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.160771:0:7485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.160780:0:7485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951507.160800:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270464:0@lo:101: 00000100:00100000:0.0:1783951507.160883:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951507.160921:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d505a2840 going to sleep for 11 seconds 00000100:00100000:1.0:1783951507.165933:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624270464 00000100:00100000:1.0:1783951507.165948:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624270464 00000100:00100000:1.0:1783951507.166024:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783951507.166032:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:7485:x1870608624270464:12345-0@lo:101: 00010000:00010000:1.0:1783951507.166049:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951507.166064:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec28e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.166087:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec28e expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.166268:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec28e expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.166278:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5e400, rc 0) 00000100:00100000:1.0:1783951507.166370:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270464:12345-0@lo:101: Request processed in 339us (5486us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951507.166377:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783951507.166472:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270464:0@lo:101: 00010000:00010000:0.0:1783951507.166493:0:7485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.166502:0:7485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951507.166629:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270592:0@lo:501: 00000100:00100000:0.0:1783951507.166667:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951507.166776:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d505a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951507.168727:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624270592 00000100:00100000:2.0:1783951507.168740:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624270592 00000100:00100000:2.0:1783951507.168799:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783951507.168824:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270592:12345-0@lo:501: 00000100:00100000:2.0:1783951507.169661:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270592:12345-0@lo:501: Request processed in 852us (2991us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.169669:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783951507.169799:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270592:0@lo:501: 00000100:00100000:3.0:1783951507.169905:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270720:0@lo:503: 00000100:00100000:3.0:1783951507.169948:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951507.169977:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951507.170021:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624270720 00000100:00100000:2.0:1783951507.170025:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624270720 00000100:00100000:2.0:1783951507.170080:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783951507.170086:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270720:12345-0@lo:503: 00000100:00100000:2.0:1783951507.170437:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270720:12345-0@lo:503: Request processed in 349us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.170444:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783951507.170514:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270720:0@lo:503: 00000040:00080000:3.0:1783951507.170771:0:7485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951507.170843:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270848:0@lo:502: 00000100:00100000:3.0:1783951507.170877:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951507.171241:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.171286:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624270848 00000100:00100000:0.0:1783951507.171291:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624270848 00000100:00100000:0.0:1783951507.171314:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783951507.171319:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270848:12345-0@lo:502: 00000100:00100000:0.0:1783951507.171517:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270848:12345-0@lo:502: Request processed in 196us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.171523:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783951507.171611:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270848:0@lo:502: 00000040:00080000:3.0:1783951507.171947:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783951507.172004:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783951507.172033:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270976:0@lo:502: 00000100:00100000:3.0:1783951507.172076:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951507.172281:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951507.172299:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624270976 00000100:00100000:3.0:1783951507.172304:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624270976 00000100:00100000:3.0:1783951507.172330:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783951507.172336:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270976:12345-0@lo:502: 00000100:00100000:3.0:1783951507.172535:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624270976:12345-0@lo:502: Request processed in 197us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951507.172542:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783951507.173005:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624270976:0@lo:502: 00000040:00080000:0.0:1783951507.173248:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783951507.173262:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783951507.173720:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951507.173728:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951507.173730:0:7497:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783951507.173735:0:7497:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d7a084000 00000020:00000080:0.0:1783951507.173737:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951507.173748:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951507.173750:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951507.173751:0:7497:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783951507.173753:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783951507.173881:0:7485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783951507.173901:0:7485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951507.173921:0:7485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.173945:0:7485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951507.173987:0:7485:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783951507.173990:0:7485:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8d7a084000 10000000:01000000:1.0:1783951507.173993:0:7485:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8d7a084000 10000000:01000000:1.0:1783951507.173997:0:7485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951507.174001:0:7485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d7a084000 from 1 10000000:01000000:1.0:1783951507.174003:0:7485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951507.174035:0:7485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.174041:0:7485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.174048:0:7485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.174062:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271104:0@lo:101: 00000100:00100000:1.0:1783951507.174239:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951507.174318:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81563780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.174516:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624271104 00000100:00100000:0.0:1783951507.174523:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624271104 00000100:00100000:0.0:1783951507.174616:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783951507.174626:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624271104:12345-0@lo:101: 00010000:00010000:0.0:1783951507.174642:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951507.174658:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec29c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.174684:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec29c expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.174695:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec29c expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.174704:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d40031000, rc 0) 00000100:00100000:0.0:1783951507.174767:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271104:12345-0@lo:101: Request processed in 142us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.174772:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783951507.175418:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271104:0@lo:101: 00010000:00010000:2.0:1783951507.175438:0:7485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.175446:0:7485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.175547:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271232:0@lo:501: 00000100:00100000:2.0:1783951507.175575:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.175701:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.175767:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624271232 00000100:00100000:0.0:1783951507.175771:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624271232 00000100:00100000:0.0:1783951507.175787:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783951507.175791:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271232:12345-0@lo:501: 00000100:00100000:0.0:1783951507.176021:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271232:12345-0@lo:501: Request processed in 229us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.176027:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783951507.176087:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271232:0@lo:501: 00000100:00100000:2.0:1783951507.176228:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271360:0@lo:503: 00000100:00100000:2.0:1783951507.176267:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.176290:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.176333:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624271360 00000100:00100000:0.0:1783951507.176337:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624271360 00000100:00100000:0.0:1783951507.176353:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783951507.176357:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271360:12345-0@lo:503: 00000100:00100000:0.0:1783951507.176500:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271360:12345-0@lo:503: Request processed in 142us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.176504:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783951507.176559:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271360:0@lo:503: 00000040:00080000:2.0:1783951507.176801:0:7485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951507.176883:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271488:0@lo:502: 00000100:00100000:2.0:1783951507.176919:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.176935:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.177509:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624271488 00000100:00100000:0.0:1783951507.177515:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624271488 00000100:00100000:0.0:1783951507.177537:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783951507.177541:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271488:12345-0@lo:502: 00000100:00100000:0.0:1783951507.177764:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271488:12345-0@lo:502: Request processed in 219us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.177771:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783951507.179233:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271488:0@lo:502: 00000040:00080000:2.0:1783951507.179605:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783951507.179673:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783951507.179724:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783951507.179775:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783951507.179893:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783951507.179948:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783951507.179990:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783951507.180028:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783951507.180089:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783951507.181414:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783951507.181457:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783951507.181528:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783951507.181569:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783951507.181619:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783951507.181693:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783951507.181736:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783951507.181793:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783951507.181870:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783951507.181911:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783951507.181948:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783951507.182001:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783951507.182040:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783951507.182074:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783951507.183515:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783951507.183577:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1783951507.183624:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1783951507.183679:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1783951507.183715:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1783951507.183745:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1783951507.183795:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1783951507.184034:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1783951507.184067:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1783951507.184249:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1783951507.184306:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1783951507.184349:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1783951507.184424:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1783951507.184468:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1783951507.184521:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271616:0@lo:502: 00000100:00100000:2.0:1783951507.184621:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.184715:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.184781:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624271616 00000100:00100000:0.0:1783951507.184788:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624271616 00000100:00100000:0.0:1783951507.185074:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783951507.185084:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271616:12345-0@lo:502: 00000100:00100000:0.0:1783951507.185473:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624271616:12345-0@lo:502: Request processed in 389us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.185484:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783951507.185672:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624271616:0@lo:502: 00000040:00080000:2.0:1783951507.185772:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1783951507.185786:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783951507.186561:0:7498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783951507.186576:0:7498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e8d60538000) 00000020:00000080:2.0:1783951507.186612:0:7498:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1783951507.186968:0:7498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8d7a084000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783951507.186974:0:7498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8d7a084000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783951507.186976:0:7498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d7a084000 3 00010000:00080000:2.0:1783951507.187018:0:7498:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d757be800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1783951507.189700:0:7498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1783951507.191286:0:7498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783951507.191345:0:7498:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951507.191362:0:7498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x443dabd358eec2b1 00000100:00080000:2.0:1783951507.191374:0:7498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951507.191382:0:7498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8d757be800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951507.191428:0:7498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d7593d180 x1870608624271744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951507.191489:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1870608624271744:0@lo:38: 00000100:00100000:0.0:1783951507.191571:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951507.191648:0:7498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783951507.191751:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624271872:0@lo:400: 00000100:00100000:2.0:1783951507.191791:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624272000:0@lo:400: 00000100:00100000:2.0:1783951507.191845:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624272128:0@lo:400: 00000100:00100000:2.0:1783951507.191891:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.191947:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624272128 00000100:00100000:2.0:1783951507.191954:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624272128 00000100:00100000:2.0:1783951507.192010:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951507.192020:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624272128:12345-0@lo:400: 00000100:00100000:2.0:1783951507.192075:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624272128:12345-0@lo:400: Request processed in 56us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.192082:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783951507.193202:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951507.193222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783951507.200471:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7593ed80 x1870608624272128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951507.200492:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624272128:0@lo:400: 00000100:00100000:2.0:1783951507.200737:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951507.201435:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624271744 00000100:00100000:1.0:1783951507.201444:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624271744 00000100:00100000:1.0:1783951507.201491:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624272000 00000100:00100000:1.0:1783951507.201495:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624272000 00000100:00100000:1.0:1783951507.201532:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951507.201543:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624272000:12345-0@lo:400: 00000100:00100000:1.0:1783951507.201639:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624272000:12345-0@lo:400: Request processed in 99us (8417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951507.201656:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951507.201679:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951507.201684:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1870608624271744:12345-0@lo:38: 00010000:00080000:1.0:1783951507.201707:0:5792:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1783951507.201743:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x443dabd358eec2b8 00000004:00100000:1.0:1783951507.201759:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783951507.201790:0:5792:0:(import.c:65:import_set_state_nolock()) ffff8e8d7c11d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951507.201857:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870608624271744:12345-0@lo:38: Request processed in 171us (10285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951507.201864:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783951507.202000:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783951507.202036:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7593d180 x1870608624271744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951507.202046:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951507.202054:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783951507.202062:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783951507.202067:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783951507.202070:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d757be800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783951507.202075:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1870608624271744:0@lo:38: 00010000:00080000:1.0:1783951507.202121:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7593c000 x1870608624272000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951507.202131:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624272000:0@lo:400: 00000100:00100000:3.0:1783951507.202841:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624271872 00000100:00100000:3.0:1783951507.202849:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624271872 00000040:00080000:0.0:1783951507.203156:0:7498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1783951507.203401:0:7500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593fb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7500:1870608624272256:0@lo:901: 00000100:00100000:2.0:1783951507.203466:0:7500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951507.203495:0:7500:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951507.203623:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624272256 00000100:00100000:0.0:1783951507.203628:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624272256 00000100:00100000:0.0:1783951507.203680:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951507.203689:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7500:x1870608624272256:12345-0@lo:901: 00000100:00100000:0.0:1783951507.204080:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7500:x1870608624272256:12345-0@lo:901: Request processed in 391us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951507.204087:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783951507.204232:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783951507.204262:0:7500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7593fb80 x1870608624272256/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783951523 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951507.204275:0:7500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593fb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7500:1870608624272256:0@lo:901: 00000020:01000000:0.0:1783951507.205362:0:7485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1783951507.205395:0:7485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951507.205419:0:7485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951507.205430:0:7485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783951507.205487:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783951507.205490:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951507.205491:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951507.205493:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951507.205494:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951507.205495:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951507.205496:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951507.205498:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783951507.205499:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783951507.205505:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951507.205506:0:7485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951507.205509:0:7485:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1783951507.205511:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951507.205512:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951507.205513:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951507.205514:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951507.205515:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951507.205516:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951507.205517:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951507.205518:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783951507.205519:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783951507.205519:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951507.205520:0:7485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951507.205541:0:7485:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783951507.205555:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624272384:0@lo:253: 00000100:00100000:0.0:1783951507.205618:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951507.205656:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d505a2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951507.205906:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951507.205920:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624271872:12345-0@lo:400: 00000100:00100000:1.0:1783951507.206029:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624271872:12345-0@lo:400: Request processed in 113us (5292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951507.206038:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783951507.206474:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624272384 00000100:00100000:3.0:1783951507.206481:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624272384 00000100:00100000:3.0:1783951507.206513:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783951507.206527:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7485:x1870608624272384:12345-0@lo:253: 20000000:01000000:3.0:1783951507.206550:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783951507.206564:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1783951507.207836:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d7593f480 x1870608624271872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951507.207859:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624271872:0@lo:400: 20000000:01000000:3.0:1783951507.232959:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783951507.232977:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783951507.232996:0:5807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783951507.233000:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783951507.233023:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951507.233044:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec209 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951507.233053:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951507.233331:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec209 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951507.233347:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec209 expref: 14 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951507.233363:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1870608624272512:0@lo:104: 00000100:00100000:3.0:1783951507.233435:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951507.233521:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951507.236950:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624272512 00000100:00100000:2.0:1783951507.236967:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624272512 00000100:00100000:2.0:1783951507.237039:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951507.237052:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5807:x1870608624272512:12345-0@lo:104: 00010000:00010000:2.0:1783951507.237074:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951507.237566:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951507.237574:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:5807:x1870608624272512:12345-0@lo:104: Request processed in 525us (4139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.237581:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951507.237692:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1870608624272512:0@lo:104: 00010000:00010000:3.0:1783951507.237722:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.237882:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951507.237890:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.237898:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951507.237902:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.237911:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951507.237918:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951507.237924:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951507.237963:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.237970:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951507.238001:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238008:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f000/0x443dabd358eec209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec210 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238026:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951507.238028:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951507.238037:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951507.238045:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951507.238060:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624272640:0@lo:103: 00000100:00100000:1.0:1783951507.238228:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951507.238283:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624272640 00000100:00100000:1.0:1783951507.238288:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624272640 00010000:00010000:1.0:1783951507.238315:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec209 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951507.238344:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951507.238351:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:3315:x1870608624272640:12345-0@lo:103: 00010000:00010000:1.0:1783951507.238364:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951507.238370:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec209 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238381:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec209 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238397:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec209 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238414:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238423:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783951507.238441:0:5778:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005439907s 00010000:00010000:1.0:1783951507.238445:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238464:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238471:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238477:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238482:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9e00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951507.238487:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238494:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238510:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238521:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951507.238553:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:3315:x1870608624272640:12345-0@lo:103: Request processed in 202us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951507.238559:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951507.238631:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624272640:0@lo:103: 00010000:00010000:1.0:1783951507.238655:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238663:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951507.238679:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff9e00/0x443dabd358eec2bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951507.241637:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:7485:x1870608624272384:12345-0@lo:253: Request processed in 35103us (36010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951507.241653:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783951507.241801:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7485:1870608624272384:0@lo:253: 10000000:01000000:0.0:1783951507.241844:0:7485:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783951507.241848:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951507.241850:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951507.241851:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951507.241852:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951507.241853:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951507.241854:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951507.241856:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951507.241858:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783951507.241859:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783951507.241861:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951507.241862:0:7485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783951507.241878:0:7485:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783951507.252381:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951507.252568:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783951507.252878:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951507.253090:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783951507.253465:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951507.256673:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783951507.258231:0:7485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1783951507.552344:0:7485:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783951507.552353:0:7485:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783951507.552388:0:7485:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783951507.552464:0:7485:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783951507.552483:0:7485:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783951507.552513:0:7485:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783951507.702959:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951508.731006:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951508.855058:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951508.855094:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624272768:0@lo:13: 00000100:00100000:3.0:1783951508.855177:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951508.856710:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624272768 00000100:00100000:1.0:1783951508.856726:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624272768 00000100:00100000:1.0:1783951508.857295:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951508.857306:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624272768:12345-0@lo:13: 00002000:00000024:1.0:1783951508.857348:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951508.857425:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624272768:12345-0@lo:13: Request processed in 121us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951508.857433:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783951508.857499:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a08b480 x1870608624272768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951508.857519:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624272768:0@lo:13: 00010000:00010000:0.0:1783951509.749921:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951510.774953:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951511.798239:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951512.442321:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624272896:0@lo:400: 00000100:00100000:2.0:1783951512.442401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951512.442449:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624273408:0@lo:400: 00000100:00100000:2.0:1783951512.442476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951512.442513:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951512.442520:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624273024:0@lo:400: 00000100:00100000:2.0:1783951512.442542:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951512.442580:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624273280:0@lo:400: 00000100:00100000:2.0:1783951512.442609:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951512.442628:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951512.442634:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624273152:0@lo:400: 00000100:00100000:2.0:1783951512.442657:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951512.442685:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624272896 00000100:00100000:2.0:1783951512.442693:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624272896 00000100:00100000:2.0:1783951512.442739:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783951512.442752:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:3312:x1870608624272896:12345-0@lo:400: 00000100:00100000:2.0:1783951512.442803:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:3312:x1870608624272896:12345-0@lo:400: Request processed in 56us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951512.442831:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783951512.442865:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624273408 00000100:00100000:2.0:1783951512.442869:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624273408 00000100:00100000:2.0:1783951512.442898:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624273024 00000100:00100000:2.0:1783951512.442901:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624273024 00000100:00100000:2.0:1783951512.442914:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624273152 00000100:00100000:2.0:1783951512.442916:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624273152 00000100:00100000:2.0:1783951512.442930:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951512.442935:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624273408:12345-0@lo:400: 00000100:00100000:2.0:1783951512.442967:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624273408:12345-0@lo:400: Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951512.442973:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951512.442985:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783951512.442990:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624273024:12345-0@lo:400: 00000100:00100000:2.0:1783951512.443012:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624273024:12345-0@lo:400: Request processed in 23us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951512.443017:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783951512.443036:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783951512.443042:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624273152:12345-0@lo:400: 00000100:00100000:2.0:1783951512.443072:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624273152:12345-0@lo:400: Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951512.443077:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1783951512.443716:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783951512.444433:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593f100 x1870608624273152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951512.444451:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624273152:0@lo:400: 00000100:00100000:3.0:1783951512.445287:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624273280 00000100:00100000:3.0:1783951512.445296:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624273280 00000100:00100000:3.0:1783951512.445379:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951512.445389:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624273280:12345-0@lo:400: 00000100:00100000:3.0:1783951512.445488:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624273280:12345-0@lo:400: Request processed in 100us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951512.445495:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783951512.445540:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783951512.445567:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593e300 x1870608624273280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951512.445580:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624273280:0@lo:400: 00010000:00080000:3.0:1783951512.453115:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593fb80 x1870608624273024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951512.453137:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624273024:0@lo:400: 00000100:00100000:3.0:1783951512.453151:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624272896:0@lo:400: 00010000:00080000:3.0:1783951512.453168:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593c700 x1870608624273408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951512.453177:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624273408:0@lo:400: 00010000:00010000:2.0:1783951512.824731:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951513.846171:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951513.975801:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624273536:0@lo:13: 00000100:00100000:0.0:1783951513.975903:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951513.975975:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624273536 00000100:00100000:0.0:1783951513.975982:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624273536 00000100:00100000:0.0:1783951513.976027:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951513.976036:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624273536:12345-0@lo:13: 00002000:00000024:0.0:1783951513.976081:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951513.976129:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624273536:12345-0@lo:13: Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951513.976136:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783951513.976173:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d74fc3480 x1870608624273536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951513.976194:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624273536:0@lo:13: 00000001:02000400:3.0:1783951514.043384:0:7843:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783951514.873849:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783951515.010727:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783951515.010736:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d604cd800 from 30 10000000:01000000:0.0:1783951515.010741:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951515.010796:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.010821:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.010833:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951515.010857:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624273664:0@lo:101: 00000100:00100000:0.0:1783951515.010923:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.010967:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.011245:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624273664 00000100:00100000:2.0:1783951515.011254:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624273664 00000100:00100000:2.0:1783951515.011305:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783951515.011315:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624273664:12345-0@lo:101: 00010000:00010000:2.0:1783951515.011329:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951515.011344:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec2c6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.011368:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.011379:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.011388:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f400, rc 0) 00000100:00100000:2.0:1783951515.011427:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624273664:12345-0@lo:101: Request processed in 114us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.011445:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783951515.011509:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624273664:0@lo:101: 00010000:00010000:0.0:1783951515.011535:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.011545:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951515.011598:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624273792:0@lo:501: 00000100:00100000:0.0:1783951515.011623:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.011646:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.012144:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624273792 00000100:00100000:2.0:1783951515.012151:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624273792 00000100:00100000:2.0:1783951515.013469:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783951515.013482:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624273792:12345-0@lo:501: 00000100:00100000:2.0:1783951515.016428:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624273792:12345-0@lo:501: Request processed in 2938us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.016446:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783951515.016594:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624273792:0@lo:501: 00000100:00100000:0.0:1783951515.016650:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624273920:0@lo:503: 00000100:00100000:0.0:1783951515.016723:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.016757:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951515.016779:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624273920 00000100:00100000:0.0:1783951515.016785:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624273920 00000100:00100000:0.0:1783951515.016855:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783951515.016865:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624273920:12345-0@lo:503: 00000100:00100000:0.0:1783951515.017207:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624273920:12345-0@lo:503: Request processed in 343us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951515.017214:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783951515.017277:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624273920:0@lo:503: 00000100:00100000:2.0:1783951515.035451:0:7909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7909:1870608624274048:0@lo:502: 00000100:00100000:2.0:1783951515.035554:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.035606:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624274048 00000100:00100000:2.0:1783951515.035614:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624274048 00000100:00100000:2.0:1783951515.035673:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783951515.035683:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7909:x1870608624274048:12345-0@lo:502: 00000100:00100000:2.0:1783951515.038661:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7909:x1870608624274048:12345-0@lo:502: Request processed in 2972us (3099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.038675:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783951515.038747:0:7909:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.038776:0:7909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7909:1870608624274048:0@lo:502: 00000100:00100000:2.0:1783951515.038887:0:7909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7909:1870608624274176:0@lo:502: 00000100:00100000:2.0:1783951515.038938:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.038983:0:7909:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.039368:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624274176 00000100:00100000:1.0:1783951515.039376:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624274176 00000100:00100000:1.0:1783951515.039418:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783951515.039427:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7909:x1870608624274176:12345-0@lo:502: 00000100:00100000:1.0:1783951515.039634:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:7909:x1870608624274176:12345-0@lo:502: Request processed in 206us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.039641:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783951515.041790:0:7909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7909:1870608624274176:0@lo:502: 00000040:00080000:2.0:1783951515.043494:0:7909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783951515.043675:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783951515.043699:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951515.043712:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.043724:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951515.043742:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783951515.043745:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1783951515.043837:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783951515.043876:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.043886:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.043895:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951515.043918:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624274304:0@lo:101: 00000100:00100000:0.0:1783951515.043992:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.044039:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d505a2900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951515.044062:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624274304 00000100:00100000:0.0:1783951515.044068:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624274304 00000100:00100000:0.0:1783951515.044122:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783951515.044133:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624274304:12345-0@lo:101: 00010000:00010000:0.0:1783951515.044148:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951515.044175:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec2d4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.044203:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.044214:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951515.044231:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4800, rc 0) 00000100:00100000:0.0:1783951515.044282:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624274304:12345-0@lo:101: Request processed in 150us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951515.044289:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783951515.044417:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624274304:0@lo:101: 00010000:00010000:2.0:1783951515.044442:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.044453:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951515.044519:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624274432:0@lo:501: 00000100:00100000:2.0:1783951515.044548:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.044577:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951515.046028:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624274432 00000100:00100000:0.0:1783951515.046039:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624274432 00000100:00100000:0.0:1783951515.046241:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783951515.046253:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624274432:12345-0@lo:501: 00000100:00100000:0.0:1783951515.046582:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624274432:12345-0@lo:501: Request processed in 331us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951515.046592:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783951515.046997:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624274432:0@lo:501: 00000100:00100000:2.0:1783951515.047124:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624274560:0@lo:503: 00000100:00100000:2.0:1783951515.047407:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.047445:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951515.049061:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624274560 00000100:00100000:0.0:1783951515.049074:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624274560 00000100:00100000:0.0:1783951515.049142:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783951515.049154:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624274560:12345-0@lo:503: 00000100:00100000:0.0:1783951515.049597:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624274560:12345-0@lo:503: Request processed in 443us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951515.049606:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783951515.051360:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624274560:0@lo:503: 00000100:00100000:1.0:1783951515.052517:0:7913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7913:1870608624274688:0@lo:502: 00000100:00100000:1.0:1783951515.052601:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.052645:0:7913:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.052697:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624274688 00000100:00100000:2.0:1783951515.052705:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624274688 00000100:00100000:2.0:1783951515.052761:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783951515.052772:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:7913:x1870608624274688:12345-0@lo:502: 00000100:00100000:2.0:1783951515.058734:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:7913:x1870608624274688:12345-0@lo:502: Request processed in 5955us (6123us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.058750:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783951515.058795:0:7913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7913:1870608624274688:0@lo:502: 00000020:01000000:1.0:1783951515.058884:0:7913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951515.058894:0:7913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951515.058906:0:7913:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783951515.058913:0:7913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783951515.058915:0:7913:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783951515.058952:0:7913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7913:1870608624274816:0@lo:502: 00000100:00100000:1.0:1783951515.058999:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.059053:0:7913:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.060005:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624274816 00000100:00100000:2.0:1783951515.060014:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624274816 00000100:00100000:2.0:1783951515.060071:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783951515.060080:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:7913:x1870608624274816:12345-0@lo:502: 00000100:00100000:2.0:1783951515.060335:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:7913:x1870608624274816:12345-0@lo:502: Request processed in 255us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.060352:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783951515.060361:0:7913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7913:1870608624274816:0@lo:502: 00000020:01000000:1.0:1783951515.060407:0:7913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951515.060414:0:7913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951515.060416:0:7913:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783951515.060421:0:7913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1783951515.060698:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1783951515.060722:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783951515.060733:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.060744:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951515.060755:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783951515.060758:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d4535a000 from 30 10000000:01000000:2.0:1783951515.060761:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783951515.060791:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.060800:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.060833:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951515.060853:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624274944:0@lo:101: 00000100:00100000:2.0:1783951515.061074:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.061109:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e540 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.061124:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624274944 00000100:00100000:2.0:1783951515.061129:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624274944 00000100:00100000:2.0:1783951515.061219:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783951515.061228:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624274944:12345-0@lo:101: 00010000:00010000:2.0:1783951515.061237:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951515.061255:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec2e2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.061277:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.061287:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.061295:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:2.0:1783951515.061398:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624274944:12345-0@lo:101: Request processed in 171us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.061405:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783951515.061440:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624274944:0@lo:101: 00010000:00010000:2.0:1783951515.061453:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.061473:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951515.061519:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275072:0@lo:501: 00000100:00100000:2.0:1783951515.061547:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.061559:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.061572:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624275072 00000100:00100000:2.0:1783951515.061575:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624275072 00000100:00100000:2.0:1783951515.061596:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783951515.061602:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624275072:12345-0@lo:501: 00000100:00100000:2.0:1783951515.064083:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624275072:12345-0@lo:501: Request processed in 2407us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.064120:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783951515.064281:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275072:0@lo:501: 00000100:00100000:2.0:1783951515.064338:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275200:0@lo:503: 00000100:00100000:2.0:1783951515.064396:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.064425:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.064442:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624275200 00000100:00100000:2.0:1783951515.064447:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624275200 00000100:00100000:2.0:1783951515.064491:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783951515.064498:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624275200:12345-0@lo:503: 00000100:00100000:2.0:1783951515.064694:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624275200:12345-0@lo:503: Request processed in 195us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.064701:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783951515.064737:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275200:0@lo:503: 00000100:00100000:1.0:1783951515.066771:0:7914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7914:1870608624275328:0@lo:502: 00000100:00100000:1.0:1783951515.066899:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.066936:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624275328 00000100:00100000:1.0:1783951515.066943:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624275328 00000100:00100000:1.0:1783951515.066980:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783951515.066988:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:7914:x1870608624275328:12345-0@lo:502: 00000100:00100000:1.0:1783951515.067236:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:7914:x1870608624275328:12345-0@lo:502: Request processed in 247us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.067243:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783951515.067299:0:7914:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.067320:0:7914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7914:1870608624275328:0@lo:502: 00000100:00100000:1.0:1783951515.067367:0:7914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7914:1870608624275456:0@lo:502: 00000100:00100000:1.0:1783951515.067403:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.067430:0:7914:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.067486:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624275456 00000100:00100000:2.0:1783951515.067492:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624275456 00000100:00100000:2.0:1783951515.067524:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783951515.067531:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:7914:x1870608624275456:12345-0@lo:502: 00000100:00100000:2.0:1783951515.067668:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:7914:x1870608624275456:12345-0@lo:502: Request processed in 137us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.067675:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783951515.069840:0:7914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7914:1870608624275456:0@lo:502: 00000040:00080000:1.0:1783951515.069890:0:7914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783951515.069967:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783951515.069987:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951515.069998:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.070009:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951515.070017:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783951515.070020:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e8d4535a000 from 5 10000000:01000000:1.0:1783951515.070023:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951515.070059:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.070067:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.070076:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951515.070095:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275584:0@lo:101: 00000100:00100000:1.0:1783951515.070152:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.070185:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.070206:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624275584 00000100:00100000:1.0:1783951515.070211:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624275584 00000100:00100000:1.0:1783951515.070265:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783951515.070275:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624275584:12345-0@lo:101: 00010000:00010000:1.0:1783951515.070289:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951515.070306:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d60d5fa00/0x443dabd358eec2f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec2f0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.070345:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d60d5fa00/0x443dabd358eec2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec2f0 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.070355:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d60d5fa00/0x443dabd358eec2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2f0 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.070364:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5fa00, rc 0) 00000100:00100000:1.0:1783951515.070398:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624275584:12345-0@lo:101: Request processed in 124us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.070405:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783951515.070443:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275584:0@lo:101: 00010000:00010000:1.0:1783951515.070467:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.070486:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951515.070533:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275712:0@lo:256: 00000100:00100000:1.0:1783951515.070568:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.070582:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951515.070595:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624275712 00000100:00100000:2.0:1783951515.070602:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624275712 00000100:00100000:2.0:1783951515.070638:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783951515.070646:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624275712:12345-0@lo:256: 20000000:01000000:2.0:1783951515.070663:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951515.070689:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951515.070692:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1783951515.070778:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624275712:12345-0@lo:256: Request processed in 132us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.070785:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783951515.071435:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275712:0@lo:256: 10000000:01000000:1.0:1783951515.071503:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951515.071511:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.071520:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951515.071536:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783951515.071538:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1783951515.071541:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951515.071566:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.071574:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.071583:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951515.071598:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275840:0@lo:101: 00000100:00100000:1.0:1783951515.071633:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.071661:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.071676:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624275840 00000100:00100000:1.0:1783951515.071680:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624275840 00000100:00100000:1.0:1783951515.071710:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783951515.071717:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624275840:12345-0@lo:101: 00010000:00010000:1.0:1783951515.071726:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951515.071738:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec2fe expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.071895:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.071907:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.071927:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5f800, rc 0) 00000100:00100000:1.0:1783951515.071958:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624275840:12345-0@lo:101: Request processed in 241us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.071965:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783951515.071999:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275840:0@lo:101: 00010000:00010000:1.0:1783951515.072149:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.072160:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951515.072211:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275968:0@lo:501: 00000100:00100000:1.0:1783951515.072238:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.072258:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.072271:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624275968 00000100:00100000:1.0:1783951515.072275:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624275968 00000100:00100000:1.0:1783951515.072342:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783951515.072350:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624275968:12345-0@lo:501: 00000100:00100000:1.0:1783951515.072659:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624275968:12345-0@lo:501: Request processed in 308us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.072668:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783951515.073685:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624275968:0@lo:501: 00000100:00100000:1.0:1783951515.073732:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624276096:0@lo:503: 00000100:00100000:0.0:1783951515.073979:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.074100:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.074135:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624276096 00000100:00100000:1.0:1783951515.074141:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624276096 00000100:00100000:1.0:1783951515.074219:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783951515.074228:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624276096:12345-0@lo:503: 00000100:00100000:1.0:1783951515.074847:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624276096:12345-0@lo:503: Request processed in 618us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.074856:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783951515.075329:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624276096:0@lo:503: 00000100:00100000:2.0:1783951515.081409:0:7916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7916:1870608624276224:0@lo:502: 00000100:00100000:2.0:1783951515.081522:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.081572:0:7916:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d4300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.081672:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624276224 00000100:00100000:1.0:1783951515.081680:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624276224 00000100:00100000:1.0:1783951515.081737:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783951515.081748:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:7916:x1870608624276224:12345-0@lo:502: 00000100:00100000:1.0:1783951515.082186:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:7916:x1870608624276224:12345-0@lo:502: Request processed in 438us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.082194:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783951515.085099:0:7916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7916:1870608624276224:0@lo:502: 00000020:01000000:2.0:1783951515.085171:0:7916:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783951515.085181:0:7916:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783951515.085193:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951515.085195:0:7916:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783951515.085207:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783951515.085211:0:7916:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:2.0:1783951515.085242:0:7916:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783951515.085246:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951515.085279:0:7916:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e8d7c1d99c0) 00000020:00000080:2.0:1783951515.085307:0:7916:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1783951515.085667:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783951515.085771:0:7916:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783951515.085776:0:7916:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783951515.085786:0:7916:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eec313 00010000:00080000:2.0:1783951515.085859:0:7916:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d7f750000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1783951515.086478:0:7916:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1783951515.088594:0:7916:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1783951515.088615:0:7916:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783951515.091627:0:7916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951515.094753:0:7916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951515.096623:0:7916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1783951515.096748:0:7916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783951515.100589:0:7917:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951515.100605:0:7917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783951515.101759:0:7916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951515.101773:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783951515.101900:0:7916:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783951515.101929:0:7916:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eec31a 00000100:00080000:3.0:1783951515.101944:0:7916:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951515.101951:0:7916:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8d7f750000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951515.102452:0:7916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d7593f100 x1870608624276352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951515.102495:0:7916:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783951515.102564:0:7916:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951515.102569:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951515.102571:0:7916:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783951515.102574:0:7916:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951515.102577:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951515.102579:0:7916:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783951515.102582:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783951515.102583:0:7916:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783951515.102613:0:7916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7916:1870608624276480:0@lo:502: 00000100:00100000:2.0:1783951515.102702:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.102740:0:7916:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.103679:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624276352:0@lo:8: 00000100:00100000:1.0:1783951515.103742:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.103829:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624276480 00000100:00100000:1.0:1783951515.103836:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624276480 00000100:00100000:1.0:1783951515.103885:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783951515.103893:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:7916:x1870608624276480:12345-0@lo:502: 00000100:00100000:1.0:1783951515.104160:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:7916:x1870608624276480:12345-0@lo:502: Request processed in 267us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.104168:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783951515.104271:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624276608:0@lo:400: 00000100:00100000:3.0:1783951515.104380:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951515.104410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951515.104417:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624276736:0@lo:400: 00000100:00100000:3.0:1783951515.104446:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951515.104490:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624276608 00000100:00100000:3.0:1783951515.104495:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624276608 00000100:00100000:3.0:1783951515.104532:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624276736 00000100:00100000:3.0:1783951515.104536:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624276736 00000100:00100000:3.0:1783951515.104561:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951515.104571:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624276608:12345-0@lo:400: 00000100:00100000:3.0:1783951515.104616:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624276608:12345-0@lo:400: Request processed in 48us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951515.104624:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951515.104642:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951515.104650:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624276736:12345-0@lo:400: 00000100:00100000:3.0:1783951515.104686:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624276736:12345-0@lo:400: Request processed in 37us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951515.104692:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783951515.104717:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783951515.104746:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a08a680 x1870608624276736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951515.104770:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624276736:0@lo:400: 00010000:00080000:3.0:1783951515.104784:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a08b480 x1870608624276608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951515.104793:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624276608:0@lo:400: 00000100:00100000:2.0:1783951515.104968:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624276352 00000100:00100000:2.0:1783951515.104973:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624276352 00000100:00100000:2.0:1783951515.105002:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951515.105007:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1870608624276352:12345-0@lo:8: 00010000:00080000:2.0:1783951515.105220:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1783951515.105258:0:6589:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eec321 00002000:00100000:2.0:1783951515.105273:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e8d7f754800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783951515.105278:0:6589:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1783951515.105283:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783951515.105521:0:6589:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783951515.105767:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783951515.105794:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8d7f756000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951515.107610:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1870608624276352:12345-0@lo:8: Request processed in 2594us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.107636:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951515.107686:0:7916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:7916:1870608624276480:0@lo:502: 00000020:01000000:2.0:1783951515.107722:0:7916:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951515.107731:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951515.107734:0:7916:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783951515.107739:0:7916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1783951515.112525:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624276864:0@lo:400: 00000100:00100000:0.0:1783951515.112609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.112660:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951515.112667:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624276992:0@lo:400: 00000100:00100000:0.0:1783951515.112693:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.112870:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624276992 00000100:00100000:2.0:1783951515.112880:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624276992 00000100:00100000:2.0:1783951515.112956:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783951515.112983:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624276992:12345-0@lo:400: 00000100:00100000:2.0:1783951515.113065:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624276992:12345-0@lo:400: Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.113073:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1783951515.113114:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a089c00 x1870608624276992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951515.113130:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624276992:0@lo:400: 00000100:00080000:2.0:1783951515.113180:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951515.113987:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624276864 00000100:00100000:3.0:1783951515.113995:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624276864 00000100:00100000:3.0:1783951515.114057:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951515.114065:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624276864:12345-0@lo:400: 00000100:00100000:3.0:1783951515.114126:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624276864:12345-0@lo:400: Request processed in 62us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951515.114132:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783951515.114725:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783951515.114765:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a08bb80 x1870608624276864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951515.114778:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624276864:0@lo:400: 00010000:00080000:1.0:1783951515.116296:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593f100 x1870608624276352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951515.116309:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951515.116320:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783951515.116343:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783951515.116349:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783951515.116353:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d7f750000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783951515.116370:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783951515.116376:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624276352:0@lo:8: 00000020:01000000:1.0:1783951515.116407:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1783951515.116435:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783951515.116444:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.116455:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951515.116476:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783951515.116478:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8d585e0000 from 1 10000000:01000000:1.0:1783951515.116481:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783951515.116518:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.116526:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951515.116533:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951515.116553:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624277120:0@lo:101: 00000100:00100000:1.0:1783951515.116615:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.116651:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8120d600 going to sleep for 11 seconds 00000004:00080000:3.0:1783951515.116763:0:7917:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783951515.116990:0:7917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 232022179073ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783951515.117128:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624277120 00000100:00100000:2.0:1783951515.117136:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624277120 00000100:00100000:2.0:1783951515.117196:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783951515.117206:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624277120:12345-0@lo:101: 00010000:00010000:2.0:1783951515.117220:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951515.117242:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec328 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.117268:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec328 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.117281:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec328 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.117291:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f000, rc 0) 00000100:00100000:2.0:1783951515.117351:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624277120:12345-0@lo:101: Request processed in 147us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.117359:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783951515.117442:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624277120:0@lo:101: 00010000:00010000:2.0:1783951515.117469:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.117478:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951515.117530:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624277248:0@lo:501: 00000100:00100000:2.0:1783951515.117557:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951515.117580:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d4780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.118175:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624277248 00000100:00100000:1.0:1783951515.118190:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624277248 00000100:00100000:1.0:1783951515.118223:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783951515.118231:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624277248:12345-0@lo:501: 00000100:00100000:1.0:1783951515.118483:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624277248:12345-0@lo:501: Request processed in 252us (923us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783951515.118500:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783951515.118561:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624277248:0@lo:501: 10000000:01000000:2.0:1783951515.118588:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783951515.118596:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951515.118605:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951515.185187:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1783951515.225919:0:7918:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783951515.225946:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624277376:0@lo:13: 00000100:00100000:3.0:1783951515.225956:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1870608624277504:0@lo:7: 00000100:00100000:3.0:1783951515.226033:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.226077:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624277504 00000100:00100000:3.0:1783951515.226090:0:7918:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951515.226101:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624277504 00000100:00100000:0.0:1783951515.226171:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951515.226182:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7918:x1870608624277504:12345-0@lo:7: 00000100:00080000:3.0:1783951515.226197:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951515.227203:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.227430:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624277376 00000100:00100000:1.0:1783951515.227438:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624277376 00000100:00100000:1.0:1783951515.227585:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951515.227594:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624277376:12345-0@lo:13: 00002000:00000024:1.0:1783951515.227624:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1783951515.227681:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624277376:12345-0@lo:13: Request processed in 88us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.227689:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783951515.227857:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a08b480 x1870608624277376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951515.227878:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624277376:0@lo:13: 00002000:00080000:1.0:1783951515.231226:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1783951515.231236:0:6589:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783951515.231522:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7918:x1870608624277504:12345-0@lo:7: Request processed in 5332us (5478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951515.231537:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783951515.231645:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a08a680 x1870608624277504/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783951531 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951515.231679:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1870608624277504:0@lo:7: 00000004:00080000:3.0:1783951515.231697:0:7918:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783951515.231742:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1870608624277632:0@lo:5: 00000100:00100000:3.0:1783951515.231780:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.231854:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624277632 00000100:00100000:0.0:1783951515.231862:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624277632 00000100:00100000:2.0:1783951515.232993:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951515.233008:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7918:x1870608624277632:12345-0@lo:5: 00000100:00100000:3.0:1783951515.233039:0:7918:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0180 going to sleep for 11 seconds 00002000:00080000:2.0:1783951515.233045:0:6591:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783951515.233051:0:6591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783951515.233397:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7918:x1870608624277632:12345-0@lo:5: Request processed in 391us (1615us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783951515.233405:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783951515.233490:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a08a680 x1870608624277632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951531 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951515.233506:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1870608624277632:0@lo:5: 00000004:00080000:3.0:1783951515.233519:0:7918:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783951515.233553:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1870608624277760:0@lo:700: 00000100:00100000:3.0:1783951515.233606:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951515.233687:0:7918:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0180 going to sleep for 11 seconds 00000100:00100000:1.0:1783951515.233731:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624277760 00000100:00100000:1.0:1783951515.233737:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624277760 00000100:00100000:1.0:1783951515.233905:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951515.233915:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7918:x1870608624277760:12345-0@lo:700: 00000100:00100000:1.0:1783951515.233948:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6598:1870608624277888:0@lo:700: 00000100:00100000:1.0:1783951515.233977:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951515.234005:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de6840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951515.234038:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624277888 00000100:00100000:0.0:1783951515.234042:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624277888 00000100:00100000:0.0:1783951515.234080:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951515.234088:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6598:x1870608624277888:12345-0@lo:700: 40000000:02000000:0.0:1783951515.266643:0:5798:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1783951515.280434:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6598:x1870608624277888:12345-0@lo:700: Request processed in 46338us (46446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951515.280451:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783951515.280704:0:6598:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a1c9f80 x1870608624277888/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783951531 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951515.280721:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6598:1870608624277888:0@lo:700: 40000000:02000000:3.0:1783951515.280736:0:6598:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1783951515.397939:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1783951515.397967:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783951515.400046:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7918:x1870608624277760:12345-0@lo:700: Request processed in 166121us (166428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951515.400063:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783951515.400561:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a089c00 x1870608624277760/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783951531 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951515.400574:0:7918:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783951515.400595:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1870608624277760:0@lo:700: 00000004:02000040:0.0:1783951515.453733:0:7918:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1783951515.464173:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74fc1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1870608624278016:0@lo:5: 00000100:00100000:0.0:1783951515.464269:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951515.464329:0:7918:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951515.464371:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624278016 00000100:00100000:0.0:1783951515.464378:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624278016 00000100:00100000:0.0:1783951515.464444:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951515.465023:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7918:x1870608624278016:12345-0@lo:5: 00002000:00080000:0.0:1783951515.486866:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1783951515.486892:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783951515.489440:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7918:x1870608624278016:12345-0@lo:5: Request processed in 24979us (25164us total) trans 4294967298 rc 0/0 00010000:00080000:1.0:1783951515.489530:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d74fc1500 x1870608624278016/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951531 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951515.489550:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74fc1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1870608624278016:0@lo:5: 00000004:00080000:1.0:1783951515.489566:0:7918:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1783951515.494711:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1783951515.898660:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951516.923223:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951517.941966:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783951518.734130:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1783951518.969988:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951519.094380:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624278144:0@lo:13: 00000100:00100000:0.0:1783951519.094485:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951519.096171:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624278144 00000100:00100000:1.0:1783951519.096183:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624278144 00000100:00100000:1.0:1783951519.096409:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951519.096423:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624278144:12345-0@lo:13: 00002000:00000024:1.0:1783951519.096946:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951519.097026:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624278144:12345-0@lo:13: Request processed in 607us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951519.097035:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783951519.097172:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a6d80 x1870608624278144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951519.097196:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624278144:0@lo:13: 00000100:00080000:2.0:1783951519.097274:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951519.251033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951519.251073:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602235008 00000100:00100000:2.0:1783951519.251084:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602235008 00000100:00100000:2.0:1783951519.251135:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:2.0:1783951519.251144:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1870608602235008:12345-192.168.201.6@tcp:250: 00010000:00080000:2.0:1783951519.251172:0:5785:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 86850dbf-e7ae-4b99-b87c-55f16448ce1f@192.168.201.6@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:2.0:1783951519.251200:0:5785:0:(genops.c:1406:class_connect()) connect: client 86850dbf-e7ae-4b99-b87c-55f16448ce1f, cookie 0x443dabd358eec336 00000100:00080000:2.0:1783951519.251332:0:5785:0:(import.c:65:import_set_state_nolock()) ffff8e8d79d90800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951519.251426:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+5:2357:x1870608602235008:12345-192.168.201.6@tcp:250: Request processed in 281us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951519.251435:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:1.0:1783951519.271069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951519.271152:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602235136 00000100:00100000:2.0:1783951519.271175:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602235136 00000100:00100000:2.0:1783951519.271234:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 111 00000100:00100000:2.0:1783951519.271245:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+5:5562:x1870608602235136:12345-192.168.201.6@tcp:101: 00010000:00010000:2.0:1783951519.271264:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951519.271284:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a0384df expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.271315:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.271326:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.271335:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fc00, rc 0) 00000100:00100000:2.0:1783951519.271471:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+6:5562:x1870608602235136:12345-192.168.201.6@tcp:101: Request processed in 228us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951519.271479:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 111 00000100:00100000:2.0:1783951519.273086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951519.273147:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602235264 00000100:00100000:3.0:1783951519.273155:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602235264 00000100:00100000:3.0:1783951519.273203:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:3.0:1783951519.273213:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+6:5562:x1870608602235264:12345-192.168.201.6@tcp:501: 00000100:00100000:3.0:1783951519.273493:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+6:5562:x1870608602235264:12345-192.168.201.6@tcp:501: Request processed in 280us (409us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783951519.273502:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:1.0:1783951519.278878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951519.280863:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602235392 00000100:00100000:3.0:1783951519.280883:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602235392 00000100:00100000:2.0:1783951519.282717:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:2.0:1783951519.282731:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+6:5562:x1870608602235392:12345-192.168.201.6@tcp:101: 00010000:00010000:2.0:1783951519.282751:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951519.282772:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a0384e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.282803:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.282830:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.282849:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:2.0:1783951519.282925:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+7:5562:x1870608602235392:12345-192.168.201.6@tcp:101: Request processed in 196us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951519.282933:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:2.0:1783951519.291038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951519.291645:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602235520 00000100:00100000:0.0:1783951519.291658:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602235520 00000100:00100000:0.0:1783951519.291711:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:0.0:1783951519.291722:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+7:5562:x1870608602235520:12345-192.168.201.6@tcp:501: 00000100:00100000:0.0:1783951519.292030:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5562:x1870608602235520:12345-192.168.201.6@tcp:501: Request processed in 308us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951519.292039:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:1.0:1783951519.294108:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951519.294206:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602235648 00000100:00100000:3.0:1783951519.294215:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602235648 00000100:00100000:3.0:1783951519.294267:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:3.0:1783951519.294276:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5562:x1870608602235648:12345-192.168.201.6@tcp:503: 00000100:00100000:3.0:1783951519.294870:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5562:x1870608602235648:12345-192.168.201.6@tcp:503: Request processed in 593us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951519.294880:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:0.0:1783951519.299328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951519.301219:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602235776 00000100:00100000:2.0:1783951519.301238:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602235776 00000100:00100000:2.0:1783951519.301306:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:2.0:1783951519.301318:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5581:x1870608602235776:12345-192.168.201.6@tcp:502: 00000100:00100000:2.0:1783951519.301880:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5581:x1870608602235776:12345-192.168.201.6@tcp:502: Request processed in 561us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951519.301898:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:1.0:1783951519.328312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951519.328508:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602235904 00000100:00100000:3.0:1783951519.328518:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602235904 00000100:00100000:3.0:1783951519.328577:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1783951519.328588:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5581:x1870608602235904:12345-192.168.201.6@tcp:502: 00000100:00100000:3.0:1783951519.329840:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5581:x1870608602235904:12345-192.168.201.6@tcp:502: Request processed in 1222us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951519.329854:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:1.0:1783951519.336267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951519.336418:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602236032 00000100:00100000:2.0:1783951519.336428:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602236032 00000100:00100000:2.0:1783951519.336488:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:2.0:1783951519.336500:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5562:x1870608602236032:12345-192.168.201.6@tcp:101: 00010000:00010000:2.0:1783951519.336519:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951519.336537:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038510 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.336568:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038510 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.336579:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038510 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951519.336603:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f600, rc 0) 00000100:00100000:2.0:1783951519.336671:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5562:x1870608602236032:12345-192.168.201.6@tcp:101: Request processed in 173us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951519.336678:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:0.0:1783951519.340770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951519.341032:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602236160 00000100:00100000:3.0:1783951519.341043:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602236160 00000100:00100000:3.0:1783951519.341103:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:3.0:1783951519.341114:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5562:x1870608602236160:12345-192.168.201.6@tcp:256: 20000000:01000000:3.0:1783951519.341141:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783951519.341169:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783951519.341173:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783951519.341182:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783951519.341184:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1783951519.342733:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5562:x1870608602236160:12345-192.168.201.6@tcp:256: Request processed in 1610us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951519.342747:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:0.0:1783951519.345732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951519.346058:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602236288 00000100:00100000:1.0:1783951519.346067:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602236288 00000100:00100000:1.0:1783951519.346325:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:1.0:1783951519.346336:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5562:x1870608602236288:12345-192.168.201.6@tcp:101: 00010000:00010000:1.0:1783951519.346363:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951519.346381:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038517 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951519.346423:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951519.346451:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951519.346460:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5e600, rc 0) 00000100:00100000:1.0:1783951519.346561:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5562:x1870608602236288:12345-192.168.201.6@tcp:101: Request processed in 227us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951519.346569:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:0.0:1783951519.348678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951519.348780:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602236416 00000100:00100000:3.0:1783951519.348791:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602236416 00000100:00100000:3.0:1783951519.348972:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:3.0:1783951519.348985:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5562:x1870608602236416:12345-192.168.201.6@tcp:501: 00000100:00100000:3.0:1783951519.349437:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5562:x1870608602236416:12345-192.168.201.6@tcp:501: Request processed in 454us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951519.349446:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:0.0:1783951519.351954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951519.352141:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602236544 00000100:00100000:1.0:1783951519.352152:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602236544 00000100:00100000:1.0:1783951519.352253:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:1.0:1783951519.352265:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5562:x1870608602236544:12345-192.168.201.6@tcp:503: 00000100:00100000:1.0:1783951519.352718:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5562:x1870608602236544:12345-192.168.201.6@tcp:503: Request processed in 453us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951519.352728:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:0.0:1783951519.355432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951519.355526:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602236672 00000100:00100000:3.0:1783951519.355536:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602236672 00000100:00100000:3.0:1783951519.355593:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:3.0:1783951519.355604:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5585:x1870608602236672:12345-192.168.201.6@tcp:502: 00000100:00100000:3.0:1783951519.355938:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5585:x1870608602236672:12345-192.168.201.6@tcp:502: Request processed in 335us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951519.355947:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:0.0:1783951519.359963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951519.360106:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602236800 00000100:00100000:1.0:1783951519.360118:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602236800 00000100:00100000:1.0:1783951519.360221:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:1.0:1783951519.360233:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60acc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5585:x1870608602236800:12345-192.168.201.6@tcp:502: 00000100:00100000:1.0:1783951519.360523:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60acc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5585:x1870608602236800:12345-192.168.201.6@tcp:502: Request processed in 292us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951519.360533:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:0.0:1783951519.367876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951519.368154:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602236928 00000100:00100000:3.0:1783951519.368164:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602236928 00000100:00100000:2.0:1783951519.368344:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1783951519.368354:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1870608602236928:12345-192.168.201.6@tcp:38: 00010000:00080000:2.0:1783951519.368392:0:5791:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:2.0:1783951519.368444:0:5791:0:(genops.c:1406:class_connect()) connect: client 65c652b5-a392-4c36-a8f6-f2bd53c90279, cookie 0x443dabd358eec359 00000004:00100000:2.0:1783951519.368478:0:5791:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1783951519.368484:0:5791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1783951519.398510:0:5791:0:(import.c:65:import_set_state_nolock()) ffff8e8d79d92000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951519.398658:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2357:x1870608602236928:12345-192.168.201.6@tcp:38: Request processed in 30302us (30792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951519.398670:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00010000:00010000:0.0:1783951519.992174:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951520.119364:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624278528:0@lo:400: 00000100:00100000:2.0:1783951520.119454:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951520.119529:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951520.119536:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624278656:0@lo:400: 00000100:00100000:2.0:1783951520.119565:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951520.119603:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624278528 00000100:00100000:2.0:1783951520.119610:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624278528 00000100:00100000:2.0:1783951520.119665:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951520.119674:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624278528:12345-0@lo:400: 00000100:00100000:2.0:1783951520.119728:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624278528:12345-0@lo:400: Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951520.119749:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951520.119777:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624278656 00000100:00100000:2.0:1783951520.119780:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624278656 00000100:00100000:2.0:1783951520.119801:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951520.119857:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624278656:12345-0@lo:400: 00010000:00080000:3.0:1783951520.120097:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593d180 x1870608624278528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951520.120111:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624278528:0@lo:400: 00000100:00100000:0.0:1783951520.120464:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624278272:0@lo:400: 00000100:00100000:0.0:1783951520.120505:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951520.120542:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624278784:0@lo:400: 00000100:00100000:0.0:1783951520.120574:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951520.120596:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783951520.120602:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624278400:0@lo:400: 00000100:00100000:0.0:1783951520.120628:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951520.120646:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624278912:0@lo:400: 00000100:00100000:0.0:1783951520.120667:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951520.120699:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951520.120712:0:6589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951520.120719:0:6589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783951520.120864:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624278784 00000100:00100000:0.0:1783951520.120869:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624278784 00000100:00100000:0.0:1783951520.120914:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624278400 00000100:00100000:0.0:1783951520.120917:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624278400 00000100:00100000:0.0:1783951520.120931:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783951520.120937:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624278784:12345-0@lo:400: 00000100:00100000:0.0:1783951520.120979:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624278784:12345-0@lo:400: Request processed in 42us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951520.120986:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783951520.120999:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951520.121005:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624278400:12345-0@lo:400: 00000100:00100000:0.0:1783951520.121033:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624278400:12345-0@lo:400: Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951520.121038:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1783951520.121051:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783951520.121259:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593c000 x1870608624278400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951520.121271:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624278400:0@lo:400: 00010000:00080000:0.0:1783951520.121294:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593f100 x1870608624278784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951520.121302:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624278784:0@lo:400: 00000100:00100000:0.0:1783951520.121349:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624278912 00000100:00100000:0.0:1783951520.121352:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624278912 00000100:00100000:0.0:1783951520.121388:0:6589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951520.121396:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951520.121403:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624278912:12345-0@lo:400: 00000100:00100000:0.0:1783951520.121438:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624278912:12345-0@lo:400: Request processed in 35us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951520.121444:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783951520.121458:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783951520.121473:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593c700 x1870608624278912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951520.121481:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783951520.121491:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624278912:0@lo:400: 00000100:00100000:2.0:1783951520.121689:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624278656:12345-0@lo:400: Request processed in 1881us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951520.121696:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951520.121772:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624278272 00000100:00100000:3.0:1783951520.121777:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624278272 00000100:00100000:3.0:1783951520.121841:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783951520.121855:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624278272:12345-0@lo:400: 00000100:00100000:3.0:1783951520.121900:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624278272:12345-0@lo:400: Request processed in 47us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951520.121906:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783951520.125531:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624278272:0@lo:400: 00010000:00080000:0.0:1783951520.125608:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7593ed80 x1870608624278656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951520.125622:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624278656:0@lo:400: 00000100:00100000:0.0:1783951520.410941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951520.410996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951520.411145:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602237056 00000100:00100000:3.0:1783951520.411157:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602237184 00000100:00100000:1.0:1783951520.411157:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602237056 00000100:00100000:3.0:1783951520.411164:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602237184 00000100:00100000:1.0:1783951520.411339:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1783951520.411350:0:5792:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951520.411363:0:5792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1783951520.411393:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951520.412700:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1783951520.412726:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:5562:x1870608602237184:12345-192.168.201.6@tcp:41: 00000004:00000024:3.0:1783951520.412779:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783951520.412790:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:0:x1870608602237056:12345-192.168.201.6@tcp:41: 00000004:00000024:1.0:1783951520.412836:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783951520.412892:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:5562:x1870608602237184:12345-192.168.201.6@tcp:41: Request processed in 180us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951520.412899:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1783951520.413430:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:0:x1870608602237056:12345-192.168.201.6@tcp:41: Request processed in 2079us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951520.413438:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1783951520.415804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951520.416003:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602237312 00000100:00100000:3.0:1783951520.416018:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602237312 00000100:00100000:3.0:1783951520.416171:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1783951520.416184:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:5562:x1870608602237312:12345-192.168.201.6@tcp:40: 00000100:00100000:3.0:1783951520.416292:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:5562:x1870608602237312:12345-192.168.201.6@tcp:40: Request processed in 110us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951520.416300:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1783951520.423705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951520.423831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951520.423880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951520.423909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951520.423945:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602237440 00000100:00100000:0.0:1783951520.423958:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602237440 00000100:00100000:0.0:1783951520.423993:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602237568 00000100:00100000:0.0:1783951520.423995:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602237568 00000100:00100000:0.0:1783951520.424017:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1783951520.424026:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1870608602237440:12345-192.168.201.6@tcp:8: 00010000:00080000:0.0:1783951520.424058:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp t0 exp 0000000000000000 cur 237 last 0 00000100:00100000:3.0:1783951520.424190:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602237696 00000100:00100000:3.0:1783951520.424194:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602237696 00000100:00100000:3.0:1783951520.424228:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1783951520.424235:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:5562:x1870608602237696:12345-192.168.201.6@tcp:33: 00000100:00100000:2.0:1783951520.425439:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602237824 00000100:00100000:2.0:1783951520.425449:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602237824 00000100:00100000:2.0:1783951520.425493:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:2.0:1783951520.425503:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d50470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2359:x1870608602237824:12345-192.168.201.6@tcp:400: 00000020:00000080:0.0:1783951520.425562:0:6589:0:(genops.c:1406:class_connect()) connect: client 65c652b5-a392-4c36-a8f6-f2bd53c90279, cookie 0x443dabd358eec360 00002000:00100000:0.0:1783951520.425578:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 65c652b5-a392-4c36-a8f6-f2bd53c90279/ffff8e8d7fc6b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1783951520.425590:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d50470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2359:x1870608602237824:12345-192.168.201.6@tcp:400: Request processed in 88us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951520.425598:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00002000:00100000:0.0:1783951520.425600:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783951520.425769:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1783951520.425775:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1870608602237568:12345-192.168.201.6@tcp:8: 00010000:00080000:2.0:1783951520.425798:0:6591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1783951520.425838:0:6591:0:(genops.c:1406:class_connect()) connect: client 65c652b5-a392-4c36-a8f6-f2bd53c90279, cookie 0x443dabd358eec367 00002000:00100000:2.0:1783951520.425844:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 65c652b5-a392-4c36-a8f6-f2bd53c90279/ffff8e8d79d97800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951520.425863:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783951520.427298:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783951520.427335:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8e8d79d96000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951520.427399:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2357:x1870608602237568:12345-192.168.201.6@tcp:8: Request processed in 1621us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951520.427413:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00002000:00080000:0.0:1783951520.427961:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783951520.427980:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8d7fc6d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951520.428011:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2357:x1870608602237440:12345-192.168.201.6@tcp:8: Request processed in 3984us (4129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951520.428019:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000004:00080000:1.0:1783951520.454476:0:5794:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30169us 00000004:00200000:2.0:1783951520.485142:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783951520.485332:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:5562:x1870608602237696:12345-192.168.201.6@tcp:33: Request processed in 61091us (64751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951520.485346:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1783951520.630248:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951520.630286:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624279040:0@lo:13: 00000100:00100000:2.0:1783951520.630402:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951520.630556:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624279040 00000100:00100000:1.0:1783951520.630567:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624279040 00000100:00100000:1.0:1783951520.630642:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951520.630656:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624279040:12345-0@lo:13: 00002000:00000024:1.0:1783951520.630687:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951520.630743:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624279040:12345-0@lo:13: Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951520.630751:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783951520.630857:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a1ca300 x1870608624279040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951520.630877:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624279040:0@lo:13: 00000100:00100000:2.0:1783951520.778530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951520.778646:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602237952 00000100:00100000:3.0:1783951520.778655:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602237952 00000100:00100000:3.0:1783951520.778710:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1783951520.778722:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:5602:x1870608602237952:12345-192.168.201.6@tcp:101: 00010000:00010000:3.0:1783951520.778747:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951520.778789:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9a00/0x443dabd358eec36e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038541 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951520.778919:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec375 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951520.778931:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951520.778944:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951520.779313:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783951520.779318:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951520.779404:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951520.779481:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9a00/0x443dabd358eec36e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038541 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951520.779496:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec375 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038541 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951520.779503:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:3.0:1783951520.779506:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951520.779515:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:3.0:1783951520.779675:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:5602:x1870608602237952:12345-192.168.201.6@tcp:101: Request processed in 956us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951520.779682:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:2.0:1783951521.014219:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951522.039574:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783951522.740252:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000100:00100000:3.0:1783951522.983668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951522.984495:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602238080 00000100:00100000:1.0:1783951522.984506:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602238080 00000100:00100000:1.0:1783951522.984703:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1783951522.984715:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:5654:x1870608602238080:12345-192.168.201.6@tcp:41: 00000004:00000024:1.0:1783951522.984765:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783951522.986145:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:5654:x1870608602238080:12345-192.168.201.6@tcp:41: Request processed in 1427us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951522.986156:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:2.0:1783951522.988724:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951522.989701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951522.989793:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602238208 00000100:00100000:1.0:1783951522.989803:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602238208 00000100:00100000:1.0:1783951522.989904:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1783951522.989915:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:5654:x1870608602238208:12345-192.168.201.6@tcp:13: 00002000:00000024:1.0:1783951522.989957:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951522.990027:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:5654:x1870608602238208:12345-192.168.201.6@tcp:13: Request processed in 114us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951522.990035:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00080000:2.0:1783951522.990296:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951522.995271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951522.995398:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602238336 00000100:00100000:1.0:1783951522.995408:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602238336 00000100:00100000:1.0:1783951522.995507:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1783951522.995519:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:5654:x1870608602238336:12345-192.168.201.6@tcp:13: 00002000:00000024:1.0:1783951522.995576:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951522.995643:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:5654:x1870608602238336:12345-192.168.201.6@tcp:13: Request processed in 127us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951522.995651:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:2.0:1783951522.995702:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783951523.063040:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951524.092349:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951524.214173:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624279168:0@lo:13: 00000100:00100000:0.0:1783951524.214257:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951524.214337:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624279168 00000100:00100000:1.0:1783951524.214346:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624279168 00000100:00100000:1.0:1783951524.214418:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951524.214427:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624279168:12345-0@lo:13: 00002000:00000024:1.0:1783951524.214465:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783951524.214500:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951524.214512:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624279168:12345-0@lo:13: Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951524.214518:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783951524.214529:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a4380 x1870608624279168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951524.214558:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624279168:0@lo:13: 00000001:00100000:0.0:1783951524.784460:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000001:00100000:2.0:1783951524.807231:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00010000:00010000:2.0:1783951525.110095:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951525.238585:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624279680:0@lo:400: 00000100:00100000:3.0:1783951525.238668:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951525.238734:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951525.238739:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624279552:0@lo:400: 00000100:00100000:3.0:1783951525.238763:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951525.239131:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624279424:0@lo:400: 00000100:00100000:1.0:1783951525.239162:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951525.239192:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624279936:0@lo:400: 00000100:00100000:1.0:1783951525.239213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951525.239236:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783951525.239241:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624279296:0@lo:400: 00000100:00100000:1.0:1783951525.239267:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951525.239314:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624279808:0@lo:400: 00000100:00100000:1.0:1783951525.239337:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951525.239368:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624279680 00000100:00100000:1.0:1783951525.239375:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624279680 00000100:00100000:1.0:1783951525.239423:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624279936 00000100:00100000:1.0:1783951525.239426:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624279936 00000100:00100000:1.0:1783951525.239458:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951525.239467:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624279680:12345-0@lo:400: 00000100:00100000:1.0:1783951525.239522:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624279680:12345-0@lo:400: Request processed in 55us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951525.239529:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951525.239548:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951525.239554:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624279936:12345-0@lo:400: 00000100:00100000:1.0:1783951525.239585:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624279936:12345-0@lo:400: Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951525.239591:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951525.239611:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624279552 00000100:00100000:1.0:1783951525.239615:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624279552 00000100:00100000:1.0:1783951525.239641:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624279424 00000100:00100000:1.0:1783951525.239643:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624279424 00000100:00100000:1.0:1783951525.239655:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624279808 00000100:00100000:1.0:1783951525.239658:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624279808 00000100:00100000:1.0:1783951525.239671:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951525.239678:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624279552:12345-0@lo:400: 00000100:00100000:2.0:1783951525.239752:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951525.239762:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624279424:12345-0@lo:400: 00000100:00100000:2.0:1783951525.239842:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624279424:12345-0@lo:400: Request processed in 82us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951525.239848:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951525.239862:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951525.239869:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624279808:12345-0@lo:400: 00000100:00100000:2.0:1783951525.239892:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624279808:12345-0@lo:400: Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951525.239906:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951525.239925:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624279296 00000100:00100000:2.0:1783951525.239929:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624279296 00000100:00100000:2.0:1783951525.239953:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783951525.239959:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d50473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624279296:12345-0@lo:400: 00000100:00100000:2.0:1783951525.239989:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d50473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624279296:12345-0@lo:400: Request processed in 30us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951525.239995:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1783951525.240073:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951525.240078:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951525.240109:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624279296:0@lo:400: 00000100:00100000:2.0:1783951525.240124:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624279808:0@lo:400: 00000100:00100000:2.0:1783951525.240134:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624279424:0@lo:400: 00010000:00080000:2.0:1783951525.240147:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a4700 x1870608624279936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951525.240158:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624279936:0@lo:400: 00000100:00100000:1.0:1783951525.241261:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624279552:12345-0@lo:400: Request processed in 1579us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951525.241273:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783951525.241761:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624279552:0@lo:400: 00010000:00080000:3.0:1783951525.241777:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a7100 x1870608624279680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951525.241903:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624279680:0@lo:400: 00000100:00100000:2.0:1783951525.714642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951525.714685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951525.714737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951525.714765:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951525.714793:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602238464 00000100:00100000:2.0:1783951525.714803:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602238464 00000100:00100000:2.0:1783951525.714880:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:2.0:1783951525.714890:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2358:x1870608602238464:12345-192.168.201.6@tcp:400: 00000100:00100000:2.0:1783951525.714962:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2358:x1870608602238464:12345-192.168.201.6@tcp:400: Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951525.714979:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:2.0:1783951525.715013:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602238848 00000100:00100000:2.0:1783951525.715017:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602238848 00000100:00100000:2.0:1783951525.715051:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602238720 00000100:00100000:2.0:1783951525.715054:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602238720 00000100:00100000:2.0:1783951525.715075:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1783951525.715081:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602238848:12345-192.168.201.6@tcp:400: 00000100:00100000:2.0:1783951525.715110:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602238848:12345-192.168.201.6@tcp:400: Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951525.715116:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1783951525.715128:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1783951525.715135:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602238720:12345-192.168.201.6@tcp:400: 00000100:00100000:2.0:1783951525.715158:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602238720:12345-192.168.201.6@tcp:400: Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951525.715164:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:2.0:1783951525.715306:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951525.715311:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951525.717963:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602238592 00000100:00100000:3.0:1783951525.717979:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602238592 00000100:00100000:3.0:1783951525.718137:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1783951525.718150:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602238592:12345-192.168.201.6@tcp:400: 00000100:00100000:3.0:1783951525.718246:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602238592:12345-192.168.201.6@tcp:400: Request processed in 98us (3613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951525.718255:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00080000:2.0:1783951525.720441:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951525.751027:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951525.751053:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624280064:0@lo:13: 00000100:00100000:0.0:1783951525.751123:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951525.751231:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624280064 00000100:00100000:3.0:1783951525.751239:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624280064 00000100:00100000:3.0:1783951525.751298:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951525.751309:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624280064:12345-0@lo:13: 00002000:00000024:3.0:1783951525.751348:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951525.751404:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624280064:12345-0@lo:13: Request processed in 96us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951525.751411:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1783951525.751483:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a7100 x1870608624280064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951525.751502:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624280064:0@lo:13: 00000001:02000400:2.0:1783951525.883289:0:8157:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783951526.134340:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951527.159119:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951528.191559:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951529.206170:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951529.347568:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624280192:0@lo:13: 00000100:00100000:3.0:1783951529.347646:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951529.347713:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624280192 00000100:00100000:3.0:1783951529.349884:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624280192 00000100:00100000:3.0:1783951529.350090:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951529.350102:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624280192:12345-0@lo:13: 00002000:00000024:3.0:1783951529.350155:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951529.350296:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624280192:12345-0@lo:13: Request processed in 195us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951529.350304:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783951529.350367:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a5c00 x1870608624280192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951529.350393:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624280192:0@lo:13: 00000100:00080000:2.0:1783951529.350699:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1783951529.447074:0:8305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe62d8cd50 20000000:00000080:2.0:1783951529.447091:0:8305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8d76e36400 uarg=0000000000000000 20000000:01000000:2.0:1783951529.447137:0:8305:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783951529.447139:0:8305:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783951529.447142:0:8305:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783951529.447146:0:8305:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783951529.447151:0:8305:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783951529.447168:0:8305:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783951529.447171:0:8305:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783951529.447615:0:8305:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783951529.447618:0:8305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783951529.450458:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1783951529.451679:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1783951529.452091:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1783951529.452367:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1783951529.452387:0:8305:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783951529.452391:0:8305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783951529.458455:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1783951529.460170:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1783951529.460268:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1783951529.460297:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1783951529.460310:0:8305:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783951529.460312:0:8305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783951529.461339:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1783951529.461738:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1783951529.461851:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1783951529.461896:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1783951529.461909:0:8305:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783951529.461911:0:8305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783951529.462887:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1783951529.463589:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1783951529.463625:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1783951529.463645:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1783951529.463657:0:8305:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783951529.463675:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.463691:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec272 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.463697:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec29c expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465055:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465060:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465065:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465069:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465073:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec328 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465079:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465083:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465088:0:8305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465144:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465158:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 9 pid: 5785 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.465180:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280320:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951529.465304:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465310:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 9 pid: 5786 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.465316:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280448:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951529.465336:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec328 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465342:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec328 expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.465347:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280576:0@lo:104: 00000100:00100000:3.0:1783951529.465376:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951529.465400:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465406:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.465411:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280704:0@lo:104: 00000100:00100000:3.0:1783951529.465425:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951529.465448:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465456:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.465470:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280832:0@lo:104: 00000100:00100000:1.0:1783951529.465483:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1783951529.465496:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.465501:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951529.465503:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.465512:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280960:0@lo:104: 00000100:00100000:1.0:1783951529.465530:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624280576 00000100:00100000:3.0:1783951529.465532:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951529.465536:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624280576 00010000:00010000:3.0:1783951529.465545:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465553:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 18 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.465560:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624281088:0@lo:104: 00000100:00100000:3.0:1783951529.465577:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951529.465580:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624280704 00000100:00100000:1.0:1783951529.465583:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624280704 00010000:00010000:3.0:1783951529.465591:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec29c expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.465593:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624280832 00000100:00100000:1.0:1783951529.465595:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624280832 00010000:00010000:3.0:1783951529.465600:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec29c expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.465604:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624280960 00000100:00100000:1.0:1783951529.465606:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624280960 00000100:00100000:3.0:1783951529.465608:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624281216:0@lo:104: 00000100:00100000:1.0:1783951529.465613:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624281088 00000100:00100000:1.0:1783951529.465615:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624281088 00000100:00100000:3.0:1783951529.465626:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951529.465627:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951529.465636:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+7:8305:x1870608624280576:12345-0@lo:104: 00010000:00010000:3.0:1783951529.465640:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec272 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.465650:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465657:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec272 expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.465665:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624281344:0@lo:104: 00010000:00010000:1.0:1783951529.465698:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951529.465703:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+7:8305:x1870608624280576:12345-0@lo:104: Request processed in 69us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.465711:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951529.465715:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951529.465726:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624281216 00000100:00100000:3.0:1783951529.465729:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d60577780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951529.465729:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624281216 00000100:00100000:1.0:1783951529.465738:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624281344 00000100:00100000:1.0:1783951529.465740:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624281344 00000100:00100000:3.0:1783951529.465749:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280576:0@lo:104: 00000100:00100000:1.0:1783951529.465750:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951529.465754:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75917c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+8:8305:x1870608624280704:12345-0@lo:104: 00010000:00010000:1.0:1783951529.465779:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465788:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951529.465794:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465801:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5fc00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951529.465804:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.465835:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1783951529.465838:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.465840:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75917c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+8:8305:x1870608624280704:12345-0@lo:104: Request processed in 85us (414us total) trans 0 rc 0/0 10000000:00010000:3.0:1783951529.465845:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.465846:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:01000000:3.0:1783951529.465852:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783951529.465880:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.465881:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1783951529.465886:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783951529.465887:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+7:8305:x1870608624280832:12345-0@lo:104: 00010000:00010000:1.0:1783951529.465893:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.465904:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.465919:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783951529.465923:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+7:8305:x1870608624280832:12345-0@lo:104: Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.465929:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951529.465940:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951529.465946:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+6:8305:x1870608624280960:12345-0@lo:104: 00010000:00010000:1.0:1783951529.465954:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.465978:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783951529.465982:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+6:8305:x1870608624280960:12345-0@lo:104: Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.465987:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951529.465999:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951529.466004:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:8305:x1870608624281088:12345-0@lo:104: 00010000:00010000:1.0:1783951529.466018:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466044:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783951529.466049:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:8305:x1870608624281088:12345-0@lo:104: Request processed in 45us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.466055:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951529.466067:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951529.466072:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:8305:x1870608624281216:12345-0@lo:104: 00010000:00010000:1.0:1783951529.466079:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466104:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783951529.466109:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:8305:x1870608624281216:12345-0@lo:104: Request processed in 37us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.466114:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951529.466125:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951529.466132:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:8305:x1870608624281344:12345-0@lo:104: 00010000:00010000:1.0:1783951529.466139:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466164:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1783951529.466169:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:8305:x1870608624281344:12345-0@lo:104: Request processed in 39us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.466175:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1783951529.466183:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5fc00/0x443dabd358eec328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec32f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.466198:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783951529.466202:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466202:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783951529.466207:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951529.466211:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.466226:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951529.466232:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951529.466237:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951529.466359:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783951529.466371:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466378:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f800 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951529.466381:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466388:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951529.466394:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951529.466399:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951529.466417:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466423:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951529.466428:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466433:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d4165f800/0x443dabd358eec2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466442:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951529.466445:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466451:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40030c00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951529.466454:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466469:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951529.466476:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624281600:0@lo:103: 10000000:00010000:1.0:1783951529.466489:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951529.466495:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783951529.466506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951529.466508:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466514:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951529.466528:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951529.466535:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1783951529.466535:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d40030c00/0x443dabd358eec2c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2cd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951529.466540:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624281472:0@lo:103: 00010000:00010000:1.0:1783951529.466544:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951529.466547:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466552:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5ea00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951529.466555:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951529.466558:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951529.466562:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951529.466569:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951529.466579:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783951529.466580:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624281600 00000100:00100000:2.0:1783951529.466583:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624281600 00010000:00010000:1.0:1783951529.466592:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466597:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951529.466601:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 19 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466603:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466609:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec29c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2a3 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466617:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783951529.466620:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624281472 00010000:00010000:1.0:1783951529.466620:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951529.466623:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624281472 00010000:00010000:1.0:1783951529.466626:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951529.466630:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.466632:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec328 expref: 20 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466637:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951529.466643:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:1.0:1783951529.466644:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951529.466649:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783951529.466654:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:3313:x1870608624281600:12345-0@lo:103: 00010000:00010000:1.0:1783951529.466659:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.466663:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951529.466664:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951529.466668:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 20 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466678:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466684:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec279 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.466687:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 20 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.466694:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951529.466696:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951529.466697:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951529.466725:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951529.466750:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:3313:x1870608624281600:12345-0@lo:103: Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951529.466757:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783951529.466770:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783951529.466777:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624281472:12345-0@lo:103: 00010000:00010000:2.0:1783951529.466785:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951529.466791:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec328 expref: 19 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.466799:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec328 expref: 19 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.466831:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165f000/0x443dabd358eec32f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec328 expref: 19 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.466841:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951529.466862:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3313:x1870608624281472:12345-0@lo:103: Request processed in 86us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951529.466869:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783951529.466890:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624281728:0@lo:103: 00000100:00100000:2.0:1783951529.466917:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951529.466937:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951529.466943:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624281856:0@lo:103: 00000100:00100000:2.0:1783951529.466980:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951529.467002:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624281728 00000100:00100000:2.0:1783951529.467005:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624281728 00010000:00010000:2.0:1783951529.467019:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 18 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951529.467033:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624281856 00000100:00100000:2.0:1783951529.467035:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624281856 00010000:00010000:2.0:1783951529.467043:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec29c expref: 19 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951529.467054:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951529.467058:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624281728:12345-0@lo:103: 00010000:00010000:2.0:1783951529.467065:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951529.467068:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 19 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.467076:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 19 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.467085:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951529.467109:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624281728:12345-0@lo:103: Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951529.467114:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951529.467126:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951529.467132:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3314:x1870608624281856:12345-0@lo:103: 00010000:00010000:2.0:1783951529.467138:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951529.467143:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec29c expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.467161:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec29c expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951529.467171:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951529.467192:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3314:x1870608624281856:12345-0@lo:103: Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951529.467198:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951529.467241:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624281472:0@lo:103: 00000100:00100000:2.0:1783951529.467249:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624281600:0@lo:103: 00000100:00100000:2.0:1783951529.467274:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951529.467280:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624281984:0@lo:103: 00000100:00100000:2.0:1783951529.467300:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951529.467328:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624281984 00000100:00100000:2.0:1783951529.467329:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624281856:0@lo:103: 00000100:00100000:1.0:1783951529.467332:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624281984 00000100:00100000:2.0:1783951529.467337:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624281728:0@lo:103: 00010000:00010000:1.0:1783951529.467345:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec272 expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.467363:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951529.467369:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3313:x1870608624281984:12345-0@lo:103: 00010000:00010000:1.0:1783951529.467377:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951529.467381:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec272 expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.467388:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec272 expref: 18 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.467398:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951529.467431:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3313:x1870608624281984:12345-0@lo:103: Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.467437:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1783951529.467573:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.467581:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951529.467588:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.467595:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5e000/0x443dabd358eec2fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec305 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.467606:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951529.467613:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951529.467615:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951529.467623:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951529.467632:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624282112:0@lo:103: 00000100:00100000:3.0:1783951529.467657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951529.467688:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624282112 00000100:00100000:1.0:1783951529.467692:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624282112 00010000:00010000:1.0:1783951529.467707:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.467737:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951529.467743:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3312:x1870608624282112:12345-0@lo:103: 00010000:00010000:1.0:1783951529.467752:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783951529.467787:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624281984:0@lo:103: 00010000:00010000:1.0:1783951529.467833:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.467844:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.467853:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951529.467885:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951529.467885:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3312:x1870608624282112:12345-0@lo:103: Request processed in 142us (227us total) trans 0 rc 0/0 00010000:00010000:2.0:1783951529.467887:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951529.467889:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951529.467891:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1783951529.467907:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.467914:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40031a00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951529.467917:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.467924:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951529.467931:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951529.467937:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951529.467969:0:8310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.467981:0:8310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951529.467994:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.467999:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d40031a00/0x443dabd358eec2d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec2db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.468019:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624282240:0@lo:103: 00000100:00100000:1.0:1783951529.468045:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951529.468072:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624282112:0@lo:103: 00000100:00100000:1.0:1783951529.468072:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624282240 00000100:00100000:1.0:1783951529.468075:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624282240 00010000:00010000:3.0:1783951529.468099:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5f800/0x443dabd358eec305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec2fe expref: 18 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.468110:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280704:0@lo:104: 00010000:00010000:3.0:1783951529.468123:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec2e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec2e2 expref: 17 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.468131:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280832:0@lo:104: 00000100:00100000:3.0:1783951529.468139:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280960:0@lo:104: 00010000:00010000:3.0:1783951529.468146:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165f400/0x443dabd358eec2cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec2c6 expref: 16 pid: 5785 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.468153:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624281088:0@lo:104: 00010000:00010000:3.0:1783951529.468160:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d40031000/0x443dabd358eec2a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec29c expref: 15 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.468168:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624281216:0@lo:104: 00010000:00010000:3.0:1783951529.468177:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d40030e00/0x443dabd358eec279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec272 expref: 14 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.468186:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624281344:0@lo:104: 00010000:00010000:1.0:1783951529.468383:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 13 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.468414:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951529.468422:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:3314:x1870608624282240:12345-0@lo:103: 00010000:00010000:1.0:1783951529.468431:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951529.468435:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 13 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.468443:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 13 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.468452:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec2db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec2d4 expref: 13 pid: 5786 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.468462:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951529.468628:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:3314:x1870608624282240:12345-0@lo:103: Request processed in 205us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.468641:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951529.468687:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624282240:0@lo:103: 00010000:00010000:1.0:1783951529.468700:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951529.468702:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951529.468704:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951529.470500:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280320:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951529.470538:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1870608624280448:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951529.470598:0:8305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.475646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951529.475692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951529.476287:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602238976 00000100:00100000:1.0:1783951529.476298:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602238976 00010000:00010000:1.0:1783951529.476343:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 10 pid: 5785 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.476384:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602239104 00000100:00100000:1.0:1783951529.476387:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602239104 00010000:00010000:1.0:1783951529.476400:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 11 pid: 5786 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.476415:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1783951529.476424:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:2359:x1870608602238976:12345-192.168.201.6@tcp:103: 00010000:00010000:1.0:1783951529.476440:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951529.476446:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 11 pid: 5785 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476459:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 11 pid: 5785 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951529.476465:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783951529.476474:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1783951529.476491:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165fa00/0x443dabd358eec344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384e6 expref: 11 pid: 5785 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476518:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951529.476598:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2359:x1870608602238976:12345-192.168.201.6@tcp:103: Request processed in 173us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.476606:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1783951529.476625:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783951529.476633:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:2359:x1870608602239104:12345-192.168.201.6@tcp:103: 00010000:00010000:1.0:1783951529.476641:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951529.476645:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 9 pid: 5786 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476653:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 9 pid: 5786 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476663:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec33d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0384df expref: 9 pid: 5786 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476674:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476682:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476696:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476703:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476710:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476717:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476728:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951529.476733:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476743:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476755:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.476769:0:8305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951529.476771:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951529.476777:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951529.476783:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec37c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951529.476797:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:2359:x1870608602239104:12345-192.168.201.6@tcp:103: Request processed in 164us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951529.476803:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00010000:00010000:1.0:1783951530.230392:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951530.358159:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624282624:0@lo:400: 00000100:00100000:0.0:1783951530.358251:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.358324:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783951530.358332:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624282496:0@lo:400: 00000100:00100000:0.0:1783951530.358356:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.358371:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624283008:0@lo:400: 00000100:00100000:0.0:1783951530.358647:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.358895:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624282624 00000100:00100000:0.0:1783951530.358904:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624282624 00000100:00100000:0.0:1783951530.358957:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624282496 00000100:00100000:0.0:1783951530.358960:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624282496 00000100:00100000:0.0:1783951530.359001:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951530.359010:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624282624:12345-0@lo:400: 00000100:00100000:0.0:1783951530.359063:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624282624:12345-0@lo:400: Request processed in 54us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.359070:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951530.359087:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783951530.359093:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624282496:12345-0@lo:400: 00000100:00100000:0.0:1783951530.359133:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624282496:12345-0@lo:400: Request processed in 41us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.359139:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783951530.359157:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624283008 00000100:00100000:0.0:1783951530.359160:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624283008 00000100:00100000:1.0:1783951530.360218:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624282752:0@lo:400: 00000100:00100000:1.0:1783951530.360270:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.360302:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783951530.360309:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624282368:0@lo:400: 00000100:00100000:1.0:1783951530.360340:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.360366:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624282880:0@lo:400: 00000100:00100000:1.0:1783951530.360389:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.360417:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624282880 00000100:00100000:1.0:1783951530.360422:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624282880 00000100:00100000:0.0:1783951530.360601:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624282752 00000100:00100000:0.0:1783951530.360606:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624282752 00000100:00100000:0.0:1783951530.360626:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951530.360634:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624283008:12345-0@lo:400: 00000100:00100000:0.0:1783951530.360680:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624283008:12345-0@lo:400: Request processed in 46us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.360686:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951530.360712:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951530.360719:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624282752:12345-0@lo:400: 00000100:00100000:0.0:1783951530.360765:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624282752:12345-0@lo:400: Request processed in 46us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.360771:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951530.360801:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624282368 00000100:00100000:0.0:1783951530.360804:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624282368 00000100:00100000:0.0:1783951530.360850:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783951530.360856:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:3314:x1870608624282368:12345-0@lo:400: 00000100:00100000:0.0:1783951530.360899:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:3314:x1870608624282368:12345-0@lo:400: Request processed in 43us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.360905:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783951530.360970:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624282368:0@lo:400: 00010000:00080000:0.0:1783951530.360987:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8121df80 x1870608624282752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951530.360998:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624282752:0@lo:400: 00000100:00100000:2.0:1783951530.361140:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624282496:0@lo:400: 00010000:00080000:2.0:1783951530.361154:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8121e680 x1870608624283008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951530.361163:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624283008:0@lo:400: 00000100:00100000:2.0:1783951530.361174:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624282624:0@lo:400: 00000100:00100000:1.0:1783951530.368482:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951530.368514:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624282880:12345-0@lo:400: 00000100:00100000:1.0:1783951530.368633:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624282880:12345-0@lo:400: Request processed in 125us (8242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951530.368655:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951530.370636:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624282880:0@lo:400: 00000100:00080000:3.0:1783951530.370777:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951530.370785:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1783951530.678523:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783951530.678531:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d7a084000 from 39 10000000:01000000:2.0:1783951530.678536:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783951530.678589:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.678602:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.678613:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951530.678638:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283136:0@lo:101: 00000100:00100000:2.0:1783951530.678708:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951530.678777:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.679991:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624283136 00000100:00100000:0.0:1783951530.680001:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624283136 00000100:00100000:0.0:1783951530.680059:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783951530.680069:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+12:5788:x1870608624283136:12345-0@lo:101: 00010000:00010000:0.0:1783951530.680084:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951530.680099:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce5000/0x443dabd358eec38a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec383 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.680126:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce5000/0x443dabd358eec38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec383 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.680136:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce5000/0x443dabd358eec38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec383 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.680146:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5000, rc 0) 00000100:00100000:0.0:1783951530.680223:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624283136:12345-0@lo:101: Request processed in 154us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.680229:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783951530.680349:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283136:0@lo:101: 00010000:00010000:1.0:1783951530.680368:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.680378:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951530.680442:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283264:0@lo:501: 00000100:00100000:1.0:1783951530.680475:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.680508:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.680726:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624283264 00000100:00100000:3.0:1783951530.680732:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624283264 00000100:00100000:3.0:1783951530.680766:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783951530.680774:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624283264:12345-0@lo:501: 00000100:00100000:3.0:1783951530.681085:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624283264:12345-0@lo:501: Request processed in 312us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.681092:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783951530.681179:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283264:0@lo:501: 00000100:00100000:1.0:1783951530.681231:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283392:0@lo:503: 00000100:00100000:1.0:1783951530.681268:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.681295:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.681594:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624283392 00000100:00100000:2.0:1783951530.681600:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624283392 00000100:00100000:2.0:1783951530.681625:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783951530.681632:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624283392:12345-0@lo:503: 00000100:00100000:2.0:1783951530.681797:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624283392:12345-0@lo:503: Request processed in 165us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.681804:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783951530.682347:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283392:0@lo:503: 00000100:00100000:0.0:1783951530.684007:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8327:1870608624283520:0@lo:502: 00000100:00100000:0.0:1783951530.684081:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.684124:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f7740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.684301:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624283520 00000100:00100000:2.0:1783951530.684308:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624283520 00000100:00100000:2.0:1783951530.684357:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783951530.684366:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:8327:x1870608624283520:12345-0@lo:502: 00000100:00100000:2.0:1783951530.684639:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:8327:x1870608624283520:12345-0@lo:502: Request processed in 273us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.684648:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783951530.684969:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8327:1870608624283520:0@lo:502: 00000100:00100000:0.0:1783951530.685020:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8327:1870608624283648:0@lo:502: 00000100:00100000:0.0:1783951530.685054:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.685084:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f7740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.685945:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624283648 00000100:00100000:2.0:1783951530.685954:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624283648 00000100:00100000:2.0:1783951530.686002:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783951530.686011:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:8327:x1870608624283648:12345-0@lo:502: 00000100:00100000:2.0:1783951530.686276:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:8327:x1870608624283648:12345-0@lo:502: Request processed in 265us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.686283:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783951530.686504:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8327:1870608624283648:0@lo:502: 00000040:00080000:1.0:1783951530.686541:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783951530.687271:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1783951530.687291:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783951530.687303:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.687316:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951530.687326:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783951530.687329:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1783951530.687332:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783951530.687368:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.687377:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.687386:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951530.687404:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283776:0@lo:101: 00000100:00100000:2.0:1783951530.687459:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951530.687495:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.687626:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624283776 00000100:00100000:3.0:1783951530.687632:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624283776 00000100:00100000:3.0:1783951530.687674:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783951530.687684:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+13:5788:x1870608624283776:12345-0@lo:101: 00010000:00010000:3.0:1783951530.687701:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951530.687714:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff9a00/0x443dabd358eec398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec391 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.687735:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff9a00/0x443dabd358eec398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec391 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.687745:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff9a00/0x443dabd358eec398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec391 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.687754:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9a00, rc 0) 00000100:00100000:3.0:1783951530.687797:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624283776:12345-0@lo:101: Request processed in 114us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.687804:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783951530.688038:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283776:0@lo:101: 00010000:00010000:1.0:1783951530.688053:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.688062:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951530.688126:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283904:0@lo:501: 00000100:00100000:1.0:1783951530.688155:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.688202:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.688371:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624283904 00000100:00100000:0.0:1783951530.688376:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624283904 00000100:00100000:0.0:1783951530.688420:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783951530.688428:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624283904:12345-0@lo:501: 00000100:00100000:0.0:1783951530.688703:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624283904:12345-0@lo:501: Request processed in 276us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.688710:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783951530.688858:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624283904:0@lo:501: 00000100:00100000:1.0:1783951530.688888:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624284032:0@lo:503: 00000100:00100000:1.0:1783951530.688925:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.688953:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.689045:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624284032 00000100:00100000:0.0:1783951530.689049:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624284032 00000100:00100000:0.0:1783951530.689069:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783951530.689074:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624284032:12345-0@lo:503: 00000100:00100000:0.0:1783951530.689347:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624284032:12345-0@lo:503: Request processed in 164us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.689354:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783951530.689950:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624284032:0@lo:503: 00000100:00100000:1.0:1783951530.690454:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8328:1870608624284160:0@lo:502: 00000100:00100000:1.0:1783951530.690505:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.690540:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.690653:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624284160 00000100:00100000:0.0:1783951530.690658:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624284160 00000100:00100000:0.0:1783951530.690698:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783951530.690706:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:8328:x1870608624284160:12345-0@lo:502: 00000100:00100000:0.0:1783951530.691085:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:8328:x1870608624284160:12345-0@lo:502: Request processed in 379us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.691098:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783951530.691345:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8328:1870608624284160:0@lo:502: 00000020:01000000:1.0:1783951530.691376:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951530.691386:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951530.691388:0:8328:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783951530.691394:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783951530.691932:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8328:1870608624284288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951530.691980:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.692055:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.700023:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624284288 00000100:00100000:2.0:1783951530.700038:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624284288 00000100:00100000:2.0:1783951530.700106:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783951530.700116:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:8328:x1870608624284288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951530.700614:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:8328:x1870608624284288:12345-0@lo:502:llog_process_th.0 Request processed in 498us (8631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.700622:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783951530.703418:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8328:1870608624284288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951530.703474:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951530.703486:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951530.703489:0:8328:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783951530.703496:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1783951530.705958:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783951530.705995:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783951530.706007:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.706021:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951530.706033:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783951530.706036:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d604cd800 from 39 10000000:01000000:2.0:1783951530.706039:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783951530.706084:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.706094:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.706106:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951530.706138:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624284416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951530.706232:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951530.706304:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.706438:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624284416 00000100:00100000:0.0:1783951530.706445:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624284416 00000100:00100000:0.0:1783951530.706497:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783951530.706507:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:5788:x1870608624284416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951530.706521:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951530.706534:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4e00/0x443dabd358eec3a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec39f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.706560:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4e00/0x443dabd358eec3a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec39f expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.706569:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce4e00/0x443dabd358eec3a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec39f expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.706577:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4e00, rc 0) 00000100:00100000:0.0:1783951530.706633:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624284416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.706639:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783951530.706689:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624284416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951530.706707:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.706717:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951530.706781:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624284544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.715263:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.716544:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.720719:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624284544 00000100:00100000:3.0:1783951530.720744:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624284544 00000100:00100000:3.0:1783951530.720833:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783951530.720844:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624284544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951530.721866:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624284544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1021us (6608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.721877:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783951530.722718:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624284544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.722784:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624284672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.722869:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.722940:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624284672 00000100:00100000:0.0:1783951530.722947:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624284672 00000100:00100000:0.0:1783951530.722990:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783951530.722999:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624284672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.723168:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.723202:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624284672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951530.723209:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624284672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951530.723214:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783951530.723796:0:8329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8329:1870608624284800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951530.723867:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951530.724178:0:8329:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.724243:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624284800 00000100:00100000:3.0:1783951530.724248:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624284800 00000100:00100000:3.0:1783951530.724285:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783951530.724293:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:8329:x1870608624284800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951530.724516:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:8329:x1870608624284800:12345-0@lo:502:llog_process_th.0 Request processed in 223us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.724523:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783951530.726172:0:8329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8329:1870608624284800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951530.726263:0:8329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8329:1870608624284928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951530.726329:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951530.726380:0:8329:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.726421:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624284928 00000100:00100000:0.0:1783951530.726435:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624284928 00000100:00100000:0.0:1783951530.726482:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783951530.726491:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:8329:x1870608624284928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951530.726747:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:8329:x1870608624284928:12345-0@lo:502:llog_process_th.0 Request processed in 256us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.726755:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783951530.730041:0:8329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8329:1870608624284928:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783951530.730101:0:8329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783951530.730318:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783951530.730338:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951530.730350:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.730361:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951530.730371:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783951530.730373:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1783951530.730376:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951530.730417:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.730438:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.730449:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951530.730470:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.730528:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.730573:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.731761:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624285056 00000100:00100000:3.0:1783951530.731770:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624285056 00000100:00100000:3.0:1783951530.731844:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783951530.731855:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:5788:x1870608624285056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951530.731872:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951530.732354:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec3b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec3ad expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.732386:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec3ad expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.732397:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec3ad expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.732407:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9000, rc 0) 00000100:00100000:3.0:1783951530.732512:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624285056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 658us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.732520:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783951530.739062:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951530.739097:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.739112:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951530.739271:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951530.739350:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.739408:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.739470:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624285184 00000100:00100000:3.0:1783951530.739476:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624285184 00000100:00100000:3.0:1783951530.739527:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783951530.739537:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624285184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951530.739845:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624285184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.739854:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783951530.740020:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.740054:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.740095:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.740123:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.740493:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624285312 00000100:00100000:0.0:1783951530.740499:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624285312 00000100:00100000:0.0:1783951530.740539:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783951530.740546:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624285312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951530.740728:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624285312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.740745:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783951530.741371:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.741681:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8330:1870608624285440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951530.741729:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.741765:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951530.742065:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624285440 00000100:00100000:0.0:1783951530.742071:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624285440 00000100:00100000:0.0:1783951530.742108:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783951530.742116:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:8330:x1870608624285440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951530.742369:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:8330:x1870608624285440:12345-0@lo:502:llog_process_th.0 Request processed in 254us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951530.742377:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783951530.745103:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8330:1870608624285440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951530.750866:0:8330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951530.751002:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951530.751005:0:8330:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783951530.751017:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783951530.751077:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8330:1870608624285568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951530.751173:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951530.752062:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951530.755915:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624285568 00000100:00100000:1.0:1783951530.755934:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624285568 00000100:00100000:1.0:1783951530.758023:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783951530.758039:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:8330:x1870608624285568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951530.758521:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:8330:x1870608624285568:12345-0@lo:502:llog_process_th.0 Request processed in 484us (7346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951530.758529:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783951530.759909:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8330:1870608624285568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951530.759955:0:8330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951530.759965:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951530.759968:0:8330:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783951530.759974:0:8330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1783951530.760829:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1783951530.760865:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783951530.760878:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.760890:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951530.760901:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783951530.760904:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d4535a000 from 39 10000000:01000000:3.0:1783951530.760908:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783951530.760943:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.760952:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.760961:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951530.760985:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951530.761042:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951530.761082:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d60577180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.761200:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624285696 00000100:00100000:2.0:1783951530.761208:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624285696 00000100:00100000:2.0:1783951530.761256:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783951530.761266:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624285696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951530.761281:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951530.761296:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec3c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec3bb expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.761335:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec3bb expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.761347:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec3bb expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.761357:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d41513e00, rc 0) 00000100:00100000:2.0:1783951530.761410:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624285696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.761419:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783951530.762697:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951530.762717:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.762725:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951530.762794:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.762858:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951530.762942:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624285824 00000100:00100000:3.0:1783951530.762950:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624285824 00000100:00100000:3.0:1783951530.762998:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783951530.763007:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624285824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.763186:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.763306:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624285824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.763314:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783951530.763558:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.763605:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.763649:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.763674:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.763845:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624285952 00000100:00100000:2.0:1783951530.763851:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624285952 00000100:00100000:2.0:1783951530.763896:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783951530.764061:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624285952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951530.764254:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624285952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.764262:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783951530.764412:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624285952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951530.775381:0:8331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8331:1870608624286080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951530.775490:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.775597:0:8331:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.780517:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624286080 00000100:00100000:3.0:1783951530.780530:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624286080 00000100:00100000:3.0:1783951530.780608:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783951530.780620:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:8331:x1870608624286080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951530.781176:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:8331:x1870608624286080:12345-0@lo:502:llog_process_th.0 Request processed in 557us (5684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.781185:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783951530.781224:0:8331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8331:1870608624286080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951530.781293:0:8331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8331:1870608624286208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951530.781336:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.781417:0:8331:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.782208:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624286208 00000100:00100000:3.0:1783951530.782219:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624286208 00000100:00100000:3.0:1783951530.782262:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783951530.782270:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:8331:x1870608624286208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951530.782856:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:8331:x1870608624286208:12345-0@lo:502:llog_process_th.0 Request processed in 584us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.782866:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783951530.783036:0:8331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8331:1870608624286208:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783951530.783065:0:8331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783951530.783496:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783951530.783514:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951530.783525:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.783548:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951530.783559:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783951530.783561:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783951530.783565:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783951530.783599:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.783608:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.783617:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951530.783636:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624286336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951530.783677:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.783714:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.784053:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624286336 00000100:00100000:3.0:1783951530.784059:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624286336 00000100:00100000:3.0:1783951530.784109:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783951530.784117:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624286336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951530.784129:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951530.784144:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff8a00/0x443dabd358eec3d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec3c9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.784168:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff8a00/0x443dabd358eec3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec3c9 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.784179:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff8a00/0x443dabd358eec3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec3c9 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951530.784209:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8a00, rc 0) 00000100:00100000:3.0:1783951530.784253:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624286336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.784259:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783951530.784368:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624286336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951530.784383:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.784391:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951530.784444:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624286464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951530.784472:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.784505:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.784546:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624286464 00000100:00100000:2.0:1783951530.784551:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624286464 00000100:00100000:2.0:1783951530.784581:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783951530.784589:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624286464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951530.785150:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624286464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 561us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.785158:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783951530.785305:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624286464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951530.785334:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624286592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951530.785368:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.785396:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.785434:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624286592 00000100:00100000:2.0:1783951530.785439:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624286592 00000100:00100000:2.0:1783951530.785477:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783951530.785485:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624286592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951530.785682:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624286592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.785689:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783951530.791499:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624286592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951530.793415:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8332:1870608624286720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951530.793529:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951530.793582:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d60577300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.793652:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624286720 00000100:00100000:2.0:1783951530.793660:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624286720 00000100:00100000:2.0:1783951530.793711:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783951530.793721:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:8332:x1870608624286720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951530.794323:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:8332:x1870608624286720:12345-0@lo:502:llog_process_th.0 Request processed in 600us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.794333:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783951530.794477:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8332:1870608624286720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951530.794508:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951530.794518:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951530.794520:0:8332:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783951530.794528:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783951530.794556:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8332:1870608624286848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951530.794595:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951530.794620:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.794678:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624286848 00000100:00100000:2.0:1783951530.794684:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624286848 00000100:00100000:2.0:1783951530.794723:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783951530.794731:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:8332:x1870608624286848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951530.796128:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:8332:x1870608624286848:12345-0@lo:502:llog_process_th.0 Request processed in 1393us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.796140:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783951530.804145:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8332:1870608624286848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951530.805478:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951530.805492:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951530.805494:0:8332:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783951530.805500:0:8332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1783951530.805772:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1783951530.805792:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783951530.805804:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.805854:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951530.805867:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783951530.805871:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8d585e0000 from 1 10000000:01000000:0.0:1783951530.805874:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783951530.805929:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.805937:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951530.805949:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951530.805981:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624286976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951530.806067:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951530.806112:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774540 going to sleep for 11 seconds 00000100:00100000:2.0:1783951530.806518:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624286976 00000100:00100000:2.0:1783951530.806524:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624286976 00000100:00100000:2.0:1783951530.806572:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783951530.806583:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624286976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951530.806599:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951530.806615:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec3de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec3d7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.806660:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec3d7 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.806669:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec3d7 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.806677:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fc00, rc 0) 00000100:00100000:2.0:1783951530.806720:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624286976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.806726:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783951530.806750:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624286976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951530.806766:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951530.806781:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951530.807231:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624287104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951530.807255:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951530.807307:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951530.809715:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624287104 00000100:00100000:3.0:1783951530.809728:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624287104 00000100:00100000:3.0:1783951530.810788:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783951530.810806:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624287104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951530.814867:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624287104:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783951530.814932:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783951530.814945:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951530.814958:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951530.815571:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624287104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3934us (7477us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783951530.815583:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783951530.834948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951530.835063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951530.835917:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602239488 00000100:00100000:2.0:1783951530.835928:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602239488 00000100:00100000:2.0:1783951530.836020:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1783951530.836031:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602239488:12345-192.168.201.6@tcp:400: 00000100:00100000:2.0:1783951530.836127:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602239488:12345-192.168.201.6@tcp:400: Request processed in 97us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.836154:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00080000:3.0:1783951530.837790:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951530.837885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951530.840254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951530.841400:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602239616 00000100:00100000:2.0:1783951530.841413:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602239616 00000100:00100000:2.0:1783951530.841511:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1783951530.841522:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602239616:12345-192.168.201.6@tcp:400: 00000100:00100000:2.0:1783951530.841623:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602239616:12345-192.168.201.6@tcp:400: Request processed in 102us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.841631:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00080000:1.0:1783951530.842151:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951530.842639:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602239232 00000100:00100000:0.0:1783951530.842664:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602239232 00000100:00100000:2.0:1783951530.843768:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:2.0:1783951530.843782:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:2359:x1870608602239232:12345-192.168.201.6@tcp:400: 00000100:00100000:2.0:1783951530.845252:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:2359:x1870608602239232:12345-192.168.201.6@tcp:400: Request processed in 1464us (10307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951530.845266:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:3.0:1783951530.846530:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602239360 00000100:00100000:3.0:1783951530.846543:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602239360 00000100:00100000:2.0:1783951530.846774:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1783951530.846785:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602239360:12345-192.168.201.6@tcp:400: 00000100:00100000:2.0:1783951530.846875:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602239360:12345-192.168.201.6@tcp:400: Request processed in 91us (8994us total) trans 0 rc 0/0 00000100:00080000:1.0:1783951530.847148:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951530.847245:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:0.0:1783951530.870283:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951530.870311:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624287232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951530.870384:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951530.870594:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624287232 00000100:00100000:3.0:1783951530.870603:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624287232 00000100:00100000:3.0:1783951530.870656:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951530.870667:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624287232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951530.870706:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951530.870761:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624287232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951530.870785:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1783951530.871121:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db1f80 x1870608624287232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951530.871142:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624287232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783951531.254255:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951532.285753:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951532.753769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951532.753961:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602239744 00000100:00100000:3.0:1783951532.753972:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602239744 00000100:00100000:3.0:1783951532.754035:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:3.0:1783951532.754047:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:5576:x1870608602239744:12345-192.168.201.6@tcp:101: 00010000:00010000:3.0:1783951532.754066:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951532.754098:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff9200/0x443dabd358eec3e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038548 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951532.754133:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff9200/0x443dabd358eec3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038548 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951532.754145:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff9200/0x443dabd358eec3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038548 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951532.754154:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9200, rc 0) 00000100:00100000:3.0:1783951532.754228:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5576:x1870608602239744:12345-192.168.201.6@tcp:101: Request processed in 184us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951532.754235:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:3.0:1783951532.757442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951532.757639:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602239872 00000100:00100000:1.0:1783951532.757649:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602239872 00000100:00100000:1.0:1783951532.757725:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:1.0:1783951532.757736:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5576:x1870608602239872:12345-192.168.201.6@tcp:501: 00000100:00100000:1.0:1783951532.758370:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5576:x1870608602239872:12345-192.168.201.6@tcp:501: Request processed in 633us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951532.758381:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:2.0:1783951532.779643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951532.782452:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602240000 00000100:00100000:3.0:1783951532.782468:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602240000 00000100:00100000:3.0:1783951532.782585:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:3.0:1783951532.782596:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5576:x1870608602240000:12345-192.168.201.6@tcp:503: 00000100:00100000:3.0:1783951532.782887:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5576:x1870608602240000:12345-192.168.201.6@tcp:503: Request processed in 292us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951532.783221:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:2.0:1783951532.788711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951532.788918:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602240128 00000100:00100000:1.0:1783951532.788929:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602240128 00000100:00100000:1.0:1783951532.788993:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:1.0:1783951532.789004:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:6055:x1870608602240128:12345-192.168.201.6@tcp:502: 00000100:00100000:1.0:1783951532.789351:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:6055:x1870608602240128:12345-192.168.201.6@tcp:502: Request processed in 348us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951532.789360:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:0.0:1783951532.793283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951532.793374:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602240256 00000100:00100000:3.0:1783951532.793384:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602240256 00000100:00100000:3.0:1783951532.793442:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:3.0:1783951532.793451:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:6055:x1870608602240256:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783951532.793753:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:6055:x1870608602240256:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 302us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951532.793760:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:3.0:1783951532.798508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951532.798621:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602240384 00000100:00100000:2.0:1783951532.798634:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602240384 00000100:00100000:2.0:1783951532.798696:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:2.0:1783951532.798707:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5576:x1870608602240384:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951532.798737:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951532.798758:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec3ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a03854f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951532.798792:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03854f expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951532.798805:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03854f expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951532.798868:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f800, rc 0) 00000100:00100000:0.0:1783951532.809025:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5576:x1870608602240384:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 10302us (10513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951532.809040:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:2.0:1783951532.811998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951532.812187:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602240512 00000100:00100000:1.0:1783951532.812198:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602240512 00000100:00100000:1.0:1783951532.812262:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:1.0:1783951532.812274:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5576:x1870608602240512:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951532.812554:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5576:x1870608602240512:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 281us (564us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783951532.812563:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 169 00010000:00010000:2.0:1783951533.313236:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783951533.851698:0:8369:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc01b5f980 20000000:00000080:2.0:1783951533.851717:0:8369:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8d81336400 uarg=0000000000000000 20000000:01000000:2.0:1783951533.851758:0:8369:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783951533.851764:0:8369:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783951533.851770:0:8369:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783951533.854347:0:8370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1783951533.856312:0:8369:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1783951533.861789:0:8369:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1783951533.862655:0:8369:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1783951533.862745:0:8369:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1783951533.862769:0:8369:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783951533.862795:0:8369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863292:0:8369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d41512600/0x443dabd358eec168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec161 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863302:0:8369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863309:0:8369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec28e expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863318:0:8369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863325:0:8369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863385:0:8369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863400:0:8369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 9 pid: 5786 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951533.863426:0:8369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8369:1870608624287360:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951533.863533:0:8369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec28e expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863541:0:8369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec28e expref: 18 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951533.863550:0:8369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8369:1870608624287488:0@lo:104: 00000100:00100000:0.0:1783951533.863587:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783951533.863623:0:8369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.863630:0:8369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 18 pid: 5785 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951533.863649:0:8369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8369:1870608624287616:0@lo:104: 00000100:00100000:0.0:1783951533.863675:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951533.863716:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783951533.863728:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624287488 00000100:00100000:0.0:1783951533.863734:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624287488 00000100:00100000:0.0:1783951533.863766:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624287616 00000100:00100000:0.0:1783951533.863769:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624287616 00000100:00100000:0.0:1783951533.863788:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951533.863797:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:8369:x1870608624287488:12345-0@lo:104: 00010000:00010000:0.0:1783951533.864285:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.864342:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951533.864349:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:8369:x1870608624287488:12345-0@lo:104: Request processed in 553us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951533.864356:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951533.864378:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783951533.864385:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75b54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:8369:x1870608624287616:12345-0@lo:104: 00010000:00010000:0.0:1783951533.864394:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.864485:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783951533.864490:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75b54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:8369:x1870608624287616:12345-0@lo:104: Request processed in 107us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951533.864495:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1783951533.864545:0:8369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d41512600/0x443dabd358eec168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec161 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951533.864555:0:8369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d41512600/0x443dabd358eec168 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec161 expref: 18 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951533.864732:0:8369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8369:1870608624287744:0@lo:104: 00000100:00100000:0.0:1783951533.864757:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951533.864783:0:8369:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d74ecac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951533.864803:0:8369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8369:1870608624287488:0@lo:104: 00000100:00100000:2.0:1783951533.865095:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624287744 00000100:00100000:2.0:1783951533.865102:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624287744 00000100:00100000:2.0:1783951533.865133:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951533.865153:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:8369:x1870608624287744:12345-0@lo:104: 00010000:00010000:2.0:1783951533.865161:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865196:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783951533.865201:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:8369:x1870608624287744:12345-0@lo:104: Request processed in 63us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951533.865219:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783951533.865239:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951533.865244:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865252:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40031800 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951533.865256:0:8311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865264:0:8311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951533.865271:0:8311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951533.865276:0:8311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951533.865305:0:8311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865312:0:8311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951533.865336:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865343:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d40031800/0x443dabd358eec28e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec295 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865360:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951533.865363:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865379:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41513a00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951533.865382:0:8311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865389:0:8311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951533.865394:0:8311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951533.865399:0:8311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951533.865425:0:8311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865431:0:8311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951533.865438:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865443:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d41513a00/0x443dabd358eec1c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec1ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865454:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951533.865457:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865463:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951533.865466:0:8311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865484:0:8311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951533.865490:0:8311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951533.865495:0:8311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951533.865507:0:8311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865513:0:8311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951533.865527:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865533:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d4165ec00/0x443dabd358eec161 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec168 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.865548:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951533.865549:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951533.865550:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951533.865582:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624287872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951533.865612:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951533.865637:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951533.865655:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624288000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951533.865678:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951533.865703:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624288128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951533.865725:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951533.865754:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624287872 00000100:00100000:2.0:1783951533.865764:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624287872 00010000:00010000:2.0:1783951533.865784:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec28e expref: 19 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951533.865804:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624288000 00000100:00100000:0.0:1783951533.866518:0:8369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8369:1870608624287616:0@lo:104: 00000100:00100000:0.0:1783951533.866527:0:8369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8369:1870608624287744:0@lo:104: 00010000:00010000:1.0:1783951533.866782:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951533.866795:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624288128 00000100:00100000:1.0:1783951533.866799:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624288128 00000100:00100000:2.0:1783951533.873281:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624288000 00010000:00010000:2.0:1783951533.873352:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 21 pid: 5785 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951533.873401:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951533.873411:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+21:3314:x1870608624287872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951533.873429:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951533.873436:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec28e expref: 21 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.873448:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec28e expref: 21 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.873469:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5e400/0x443dabd358eec295 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec28e expref: 21 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.873486:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951533.873600:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:3314:x1870608624287872:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (7986us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951533.873609:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951533.873630:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951533.873636:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624288000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951533.873655:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951533.873659:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 19 pid: 5785 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.873690:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 19 pid: 5785 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.873700:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165fe00/0x443dabd358eec1ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec1c3 expref: 19 pid: 5785 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951533.873709:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951533.873733:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3314:x1870608624288000:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (8055us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951533.873739:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951533.873803:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624288000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951533.873992:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d41512600/0x443dabd358eec168 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec161 expref: 17 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951533.874032:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951533.874040:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:3312:x1870608624288128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951533.874047:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951533.874051:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d41512600/0x443dabd358eec168 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec161 expref: 17 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951533.874058:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d41512600/0x443dabd358eec168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec161 expref: 17 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951533.874068:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41512600/0x443dabd358eec168 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec161 expref: 17 pid: 5784 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951533.874078:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951533.874124:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:3312:x1870608624288128:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (8397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951533.874130:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951533.874581:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624287872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951533.874626:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624288128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951533.874999:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951533.878456:0:8369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8369:1870608624287360:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951533.878491:0:8369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951533.879691:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951533.880068:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602240640 00000100:00100000:3.0:1783951533.880076:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602240640 00010000:00010000:3.0:1783951533.880127:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 10 pid: 5786 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951533.880177:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:3.0:1783951533.880188:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2358:x1870608602240640:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951533.880206:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951533.880213:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 10 pid: 5786 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880226:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 10 pid: 5786 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880245:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5e600/0x443dabd358eec352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038517 expref: 10 pid: 5786 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880261:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880279:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880296:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880304:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880310:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880316:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880322:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951533.880326:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880333:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880356:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951533.880366:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951533.880584:0:8369:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951533.880594:0:8369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951533.880599:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eec3f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951533.882017:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:2358:x1870608602240640:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 1817us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951533.882031:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00010000:00010000:2.0:1783951534.326090:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951534.454903:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624288256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951534.454979:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951534.455205:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624288256 00000100:00100000:3.0:1783951534.455226:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624288256 00000100:00100000:3.0:1783951534.455291:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951534.455301:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624288256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951534.455342:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783951534.455734:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951534.455840:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624288256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 540us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951534.455848:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1783951534.455890:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db0380 x1870608624288256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951534.455912:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624288256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951534.609214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951534.610842:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602240768 00000100:00100000:0.0:1783951534.610858:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602240768 00000100:00100000:0.0:1783951534.610924:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 170 00000100:00100000:0.0:1783951534.610934:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:5576:x1870608602240768:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951534.610952:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951534.610971:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038556 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951534.611000:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951534.611011:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951534.611020:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5600, rc 0) 00000100:00100000:0.0:1783951534.611101:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5576:x1870608602240768:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 168us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951534.611121:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 170 00000100:00100000:1.0:1783951534.617928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951534.618024:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602240896 00000100:00100000:0.0:1783951534.618033:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602240896 00000100:00100000:0.0:1783951534.618102:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:0.0:1783951534.618112:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5576:x1870608602240896:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951534.618563:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5576:x1870608602240896:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 451us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951534.618573:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:2.0:1783951534.624066:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951534.625135:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602241024 00000100:00100000:0.0:1783951534.625146:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602241024 00000100:00100000:0.0:1783951534.625205:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:0.0:1783951534.625215:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5576:x1870608602241024:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951534.625464:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:5576:x1870608602241024:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 249us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951534.625473:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:3.0:1783951534.638369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951534.638748:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602241152 00000100:00100000:1.0:1783951534.638759:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602241152 00000100:00100000:1.0:1783951534.638845:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:1.0:1783951534.638856:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:6112:x1870608602241152:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951534.639138:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:6112:x1870608602241152:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 283us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951534.639146:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:2.0:1783951534.647518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951534.648510:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602241280 00000100:00100000:0.0:1783951534.648521:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602241280 00000100:00100000:0.0:1783951534.648615:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:0.0:1783951534.648625:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:6112:x1870608602241280:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951534.648916:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:6112:x1870608602241280:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 291us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951534.648925:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 174 10000000:01000000:0.0:1783951535.110168:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783951535.110177:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d7a084000 from 4 10000000:01000000:0.0:1783951535.110182:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951535.110259:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951535.110272:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951535.110284:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951535.110311:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624288384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951535.110381:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951535.110440:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d43500900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.110922:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624288384 00000100:00100000:3.0:1783951535.110932:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624288384 00000100:00100000:3.0:1783951535.110990:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783951535.111000:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624288384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951535.111016:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951535.111033:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec401 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.111071:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec401 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.111081:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec401 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.111089:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8200, rc 0) 00000100:00100000:3.0:1783951535.111148:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624288384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.111163:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783951535.111211:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624288384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951535.111231:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.111240:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951535.111292:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624288512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.111316:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.111337:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624288512 00000100:00100000:3.0:1783951535.111340:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624288512 00000100:00100000:3.0:1783951535.111359:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783951535.111364:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624288512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.112250:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624288512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 881us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.112258:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783951535.112299:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7592da80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.112312:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624288512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.112342:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624288640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.112378:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.112392:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7592da80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.112403:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624288640 00000100:00100000:3.0:1783951535.112406:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624288640 00000100:00100000:3.0:1783951535.112429:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783951535.112441:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624288640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.112592:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624288640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.112614:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783951535.112672:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624288640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.112931:0:8406:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8406:1870608624288768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951535.112965:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.112984:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624288768 00000100:00100000:3.0:1783951535.112988:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624288768 00000100:00100000:3.0:1783951535.113010:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783951535.113015:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:8406:x1870608624288768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951535.113150:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:8406:x1870608624288768:12345-0@lo:502:llog_process_th.0 Request processed in 134us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.113156:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783951535.113187:0:8406:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7592d540 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.113199:0:8406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8406:1870608624288768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783951535.113220:0:8406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951535.113229:0:8406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951535.113231:0:8406:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783951535.113238:0:8406:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d7a084000 00000020:00000080:3.0:1783951535.113240:0:8406:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783951535.124147:0:8406:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8406:1870608624288896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951535.124242:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951535.124295:0:8406:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d505a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.126929:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624288896 00000100:00100000:3.0:1783951535.126942:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624288896 00000100:00100000:3.0:1783951535.127007:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783951535.127017:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:8406:x1870608624288896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951535.127365:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:8406:x1870608624288896:12345-0@lo:502:llog_process_th.0 Request processed in 349us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.127380:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783951535.129760:0:8406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8406:1870608624288896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951535.131218:0:8406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951535.131230:0:8406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951535.131233:0:8406:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783951535.131240:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783951535.132191:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783951535.132215:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951535.132227:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.132240:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951535.132249:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951535.132252:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d604cd800 from 4 10000000:01000000:3.0:1783951535.132255:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951535.132292:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.132300:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.132312:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951535.132337:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.132400:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.132439:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.132485:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624289024 00000100:00100000:3.0:1783951535.132492:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624289024 00000100:00100000:3.0:1783951535.135915:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783951535.135942:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624289024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951535.135961:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951535.135985:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec40f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.136017:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec40f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.136030:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec40f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.136039:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8400, rc 0) 00000100:00100000:3.0:1783951535.138158:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624289024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2216us (5747us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.138173:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783951535.138256:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951535.138280:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.138293:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951535.138369:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.138405:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.138436:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.138452:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624289152 00000100:00100000:3.0:1783951535.138457:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624289152 00000100:00100000:3.0:1783951535.138495:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783951535.138503:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624289152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.141454:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624289152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2944us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.141475:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783951535.141584:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.144003:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.155727:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.155780:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d585fb900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951535.156173:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624289280 00000100:00100000:2.0:1783951535.156186:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624289280 00000100:00100000:2.0:1783951535.156247:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783951535.156258:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624289280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951535.156503:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624289280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 247us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951535.156511:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1783951535.156862:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951535.167171:0:8410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8410:1870608624289408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951535.167267:0:8410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951535.167313:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624289408 00000100:00100000:1.0:1783951535.167322:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624289408 00000100:00100000:1.0:1783951535.167374:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1783951535.167384:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:8410:x1870608624289408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951535.167902:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:8410:x1870608624289408:12345-0@lo:502:llog_process_th.0 Request processed in 519us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.167910:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1783951535.167964:0:8410:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951535.167986:0:8410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8410:1870608624289408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951535.168020:0:8410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951535.168030:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951535.168032:0:8410:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783951535.168039:0:8410:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d604cd800 00000020:00000080:1.0:1783951535.168041:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783951535.168768:0:8410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8410:1870608624289536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951535.168895:0:8410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951535.168927:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624289536 00000100:00100000:1.0:1783951535.168932:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624289536 00000100:00100000:1.0:1783951535.168967:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783951535.168974:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:8410:x1870608624289536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951535.169489:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:8410:x1870608624289536:12345-0@lo:502:llog_process_th.0 Request processed in 515us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.169499:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783951535.169725:0:8410:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951535.169746:0:8410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8410:1870608624289536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951535.169771:0:8410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951535.169778:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951535.169781:0:8410:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783951535.169785:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783951535.181796:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783951535.181867:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951535.181880:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.181895:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951535.181906:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951535.181909:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d4535a000 from 4 10000000:01000000:3.0:1783951535.181912:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951535.181950:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.181959:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.181971:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951535.181997:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.182221:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.182299:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44f85a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.182424:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624289664 00000100:00100000:3.0:1783951535.182432:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624289664 00000100:00100000:3.0:1783951535.182484:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783951535.182493:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624289664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951535.182509:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951535.183740:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec41d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.183784:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec41d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.183796:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec41d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.183806:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9600, rc 0) 00000100:00100000:3.0:1783951535.183976:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624289664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1483us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.183987:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783951535.185019:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951535.185045:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951535.187289:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951535.187390:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.187459:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.187499:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44f85a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.187524:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624289792 00000100:00100000:3.0:1783951535.187529:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624289792 00000100:00100000:3.0:1783951535.188006:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783951535.188015:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624289792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.190299:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624289792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2278us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.190314:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783951535.190386:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.190436:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.190481:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.190521:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44f85a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.191804:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624289920 00000100:00100000:3.0:1783951535.191898:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624289920 00000100:00100000:3.0:1783951535.191948:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783951535.191957:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624289920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951535.195796:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624289920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3830us (5304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.195836:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1783951535.200987:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624289920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951535.214705:0:8415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8415:1870608624290048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951535.214793:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951535.214860:0:8415:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d43500300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.215269:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624290048 00000100:00100000:3.0:1783951535.215278:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624290048 00000100:00100000:3.0:1783951535.215325:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783951535.215335:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60acc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:8415:x1870608624290048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951535.215580:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60acc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:8415:x1870608624290048:12345-0@lo:502:llog_process_th.0 Request processed in 246us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.215594:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783951535.215962:0:8415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8415:1870608624290048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951535.215994:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951535.216005:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951535.216008:0:8415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783951535.216015:0:8415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d4535a000 00000020:00000080:0.0:1783951535.216018:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783951535.216188:0:8415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8415:1870608624290176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951535.216233:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951535.216258:0:8415:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d43500300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951535.216475:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624290176 00000100:00100000:3.0:1783951535.216481:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624290176 00000100:00100000:3.0:1783951535.216526:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783951535.216544:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:8415:x1870608624290176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951535.217012:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:8415:x1870608624290176:12345-0@lo:502:llog_process_th.0 Request processed in 469us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.217019:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783951535.217741:0:8415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:8415:1870608624290176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951535.217773:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951535.217787:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951535.217789:0:8415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783951535.217793:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783951535.217887:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783951535.217906:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951535.217917:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951535.217929:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951535.359359:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951535.479583:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624290432:0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.479671:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951535.479731:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783951535.479738:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624290304:0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.479762:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951535.479778:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624290816:0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.479837:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951535.479873:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624290560:0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.479898:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951535.479916:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951535.479922:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624290688:0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.479942:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951535.479970:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624290432 00000100:00100000:1.0:1783951535.479978:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624290432 00000100:00100000:1.0:1783951535.480029:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624290304 00000100:00100000:1.0:1783951535.480033:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624290304 00000100:00100000:1.0:1783951535.480047:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624290688 00000100:00100000:1.0:1783951535.480050:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624290688 00000100:00100000:1.0:1783951535.480065:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783951535.480073:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624290432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.480144:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624290432:12345-0@lo:400:kworker.0 Request processed in 71us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.480152:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783951535.480168:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783951535.480173:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624290304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.480201:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624290304:12345-0@lo:400:kworker.0 Request processed in 27us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.480206:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783951535.480217:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951535.480223:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624290688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.480250:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624290688:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.480255:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951535.480285:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624290816 00000100:00100000:1.0:1783951535.480288:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624290816 00000100:00100000:1.0:1783951535.480313:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624290560 00000100:00100000:1.0:1783951535.480316:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624290560 00000100:00100000:1.0:1783951535.480334:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951535.480341:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624290816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.480372:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624290816:12345-0@lo:400:kworker.0 Request processed in 32us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.480378:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951535.480411:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951535.480417:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624290560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.480462:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624290560:12345-0@lo:400:kworker.0 Request processed in 45us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.480469:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1783951535.480491:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951535.480495:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951535.480533:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624290688:0@lo:400:kworker.0 00010000:00080000:1.0:1783951535.480546:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a1ca680 x1870608624290560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951535.480556:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624290560:0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.480585:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624290304:0@lo:400:kworker.0 00010000:00080000:1.0:1783951535.480594:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a1c9f80 x1870608624290816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951535.480603:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624290816:0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.480613:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624290432:0@lo:400:kworker.0 00000100:00100000:1.0:1783951535.955146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951535.955193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951535.955225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951535.955251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951535.955283:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602241536 00000100:00100000:1.0:1783951535.955294:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602241536 00000100:00100000:1.0:1783951535.955371:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:1.0:1783951535.955394:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602241536:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951535.955487:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602241536:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 96us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.955496:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:1.0:1783951535.955520:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602241664 00000100:00100000:1.0:1783951535.955524:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602241664 00000100:00100000:1.0:1783951535.955546:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602241792 00000100:00100000:1.0:1783951535.955549:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602241792 00000100:00100000:1.0:1783951535.955567:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1783951535.955573:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602241664:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951535.955597:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602241664:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.955603:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1783951535.955614:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1783951535.955621:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602241792:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951535.955643:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602241792:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951535.955649:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00080000:1.0:1783951535.955677:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951535.955682:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951535.955684:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951535.956936:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602241408 00000100:00100000:3.0:1783951535.956946:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602241408 00000100:00100000:3.0:1783951535.957282:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:3.0:1783951535.957294:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d50470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2358:x1870608602241408:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951535.957354:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d50470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2358:x1870608602241408:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 64us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.957362:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:3.0:1783951535.990140:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951535.990169:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624290944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951535.990253:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951535.990351:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624290944 00000100:00100000:3.0:1783951535.990362:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624290944 00000100:00100000:3.0:1783951535.990437:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951535.990449:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624290944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951535.990502:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951535.990554:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624290944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951535.990587:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1783951535.991024:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db2680 x1870608624290944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951535.991045:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624290944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951536.374417:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951537.398216:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951538.422859:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951539.447682:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951539.579235:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624291072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951539.579318:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951539.579595:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624291072 00000100:00100000:0.0:1783951539.579603:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624291072 00000100:00080000:2.0:1783951539.579675:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951539.579682:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783951539.579694:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624291072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951539.579731:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951539.579790:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624291072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951539.579797:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1783951539.579920:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8121d880 x1870608624291072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951539.580019:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624291072:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1783951540.176669:0:8671:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1783951540.470515:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951540.598335:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624291200:0@lo:400:kworker.0 00000100:00100000:0.0:1783951540.598411:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951540.598458:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624291712:0@lo:400:kworker.0 00000100:00100000:0.0:1783951540.598481:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951540.598502:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951540.598507:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624291584:0@lo:400:kworker.0 00000100:00100000:0.0:1783951540.598529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951540.598593:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624291200 00000100:00100000:3.0:1783951540.598600:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624291200 00000100:00100000:3.0:1783951540.598657:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1783951540.598666:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d50473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624291200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951540.598714:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d50473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624291200:12345-0@lo:400:kworker.0 Request processed in 49us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951540.598721:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783951540.598841:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624291200:0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599092:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624291328:0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951540.599153:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624291840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599175:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951540.599203:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951540.599209:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624291456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599232:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951540.599263:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624291712 00000100:00100000:1.0:1783951540.599267:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624291712 00000100:00100000:1.0:1783951540.599304:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624291328 00000100:00100000:1.0:1783951540.599307:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624291328 00000100:00100000:1.0:1783951540.599320:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624291456 00000100:00100000:1.0:1783951540.599322:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624291456 00000100:00100000:1.0:1783951540.599336:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951540.599342:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624291712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599376:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624291712:12345-0@lo:400:kworker.0 Request processed in 34us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951540.599382:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951540.599395:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951540.599401:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624291328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599430:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624291328:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951540.599444:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951540.599455:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783951540.599461:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624291456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599487:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624291456:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951540.599492:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783951540.599508:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624291584 00000100:00100000:1.0:1783951540.599511:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624291584 00000100:00100000:1.0:1783951540.599531:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624291840 00000100:00100000:1.0:1783951540.599534:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624291840 00000100:00100000:1.0:1783951540.599550:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951540.599556:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624291584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599584:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624291584:12345-0@lo:400:kworker.0 Request processed in 28us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951540.599590:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951540.599601:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951540.599606:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624291840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599629:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624291840:12345-0@lo:400:kworker.0 Request processed in 22us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951540.599634:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783951540.599650:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951540.599655:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951540.599680:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624291456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951540.599689:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624291328:0@lo:400:kworker.0 00010000:00080000:1.0:1783951540.599700:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db3800 x1870608624291840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951540.599716:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624291840:0@lo:400:kworker.0 00010000:00080000:0.0:1783951540.599857:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db0700 x1870608624291584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951540.599866:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624291584:0@lo:400:kworker.0 00000100:00100000:0.0:1783951540.599875:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624291712:0@lo:400:kworker.0 00000100:00100000:1.0:1783951541.087698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951541.088648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951541.088693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951541.088736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951541.088777:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602242304 00000100:00100000:1.0:1783951541.088787:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602242304 00000100:00100000:1.0:1783951541.088888:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602242176 00000100:00100000:1.0:1783951541.088891:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602242176 00000100:00100000:1.0:1783951541.088916:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783951541.088927:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602242304:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951541.089031:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602242304:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 106us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951541.089040:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783951541.089060:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:1.0:1783951541.089066:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602242176:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951541.089092:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602242176:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951541.089099:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00080000:1.0:1783951541.089116:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951541.089121:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951541.089484:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602241920 00000100:00100000:0.0:1783951541.089490:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602241920 00000100:00100000:0.0:1783951541.089527:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 192 00000100:00100000:0.0:1783951541.089534:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602241920:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951541.089572:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602241920:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 39us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951541.089579:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 192 00000100:00100000:3.0:1783951541.096477:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602242048 00000100:00100000:3.0:1783951541.096491:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602242048 00000100:00080000:1.0:1783951541.097078:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951541.098164:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:3.0:1783951541.098185:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602242048:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951541.098275:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602242048:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 98us (10586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951541.098283:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:0.0:1783951541.112430:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951541.112454:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624291968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951541.112538:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951541.112602:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624291968 00000100:00100000:0.0:1783951541.112609:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624291968 00000100:00100000:0.0:1783951541.112654:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783951541.112663:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624291968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951541.112699:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951541.112745:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624291968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951541.112765:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1783951541.112805:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8121df80 x1870608624291968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951541.112850:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624291968:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951541.496135:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951542.518832:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951543.547777:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951544.566993:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951544.694009:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624292096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951544.694103:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951544.694198:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624292096 00000100:00100000:2.0:1783951544.694207:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624292096 00000100:00100000:2.0:1783951544.695923:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951544.695935:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624292096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951544.695989:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951544.696067:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624292096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951544.696075:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1783951544.696138:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d5855ea00 x1870608624292096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951544.696160:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624292096:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783951544.703049:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783951545.593616:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951545.718122:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624292224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.718201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951545.719623:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951545.719640:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624292608:0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.719697:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951545.719747:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624292224 00000100:00100000:0.0:1783951545.719755:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624292224 00000100:00100000:0.0:1783951545.719799:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783951545.719822:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624292224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.719879:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624292224:12345-0@lo:400:kworker.0 Request processed in 71us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951545.719888:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783951545.719925:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624292352:0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.719963:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951545.719985:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951545.719991:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624292480:0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.720012:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951545.720038:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624292608 00000100:00100000:0.0:1783951545.720042:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624292608 00000100:00100000:0.0:1783951545.720086:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951545.720092:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624292608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.720125:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624292608:12345-0@lo:400:kworker.0 Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951545.720132:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951545.720157:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624292352 00000100:00100000:0.0:1783951545.720160:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624292352 00000100:00100000:0.0:1783951545.720194:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624292480 00000100:00100000:0.0:1783951545.720198:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624292480 00000100:00100000:0.0:1783951545.720225:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783951545.720231:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624292352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.720266:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624292352:12345-0@lo:400:kworker.0 Request processed in 35us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951545.720273:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783951545.720285:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783951545.720292:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624292480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.720330:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624292480:12345-0@lo:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951545.720336:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1783951545.720364:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951545.720400:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624292480:0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.720412:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624292352:0@lo:400:kworker.0 00010000:00080000:0.0:1783951545.720447:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d5855e680 x1870608624292608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951545.720457:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624292608:0@lo:400:kworker.0 00000100:00100000:0.0:1783951545.720466:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624292224:0@lo:400:kworker.0 00000100:00100000:2.0:1783951545.722368:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951545.722389:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624292736:0@lo:400:kworker.0 00000100:00100000:2.0:1783951545.722451:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951545.722492:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951545.722501:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624292864:0@lo:400:kworker.0 00000100:00100000:2.0:1783951545.722529:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951545.722564:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624292864 00000100:00100000:2.0:1783951545.722570:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624292864 00000100:00100000:2.0:1783951545.722623:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951545.722631:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624292864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951545.722674:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624292864:12345-0@lo:400:kworker.0 Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951545.722682:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783951545.722704:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783951545.722729:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d5855ed80 x1870608624292864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951545.722742:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624292864:0@lo:400:kworker.0 00000100:00100000:2.0:1783951545.722767:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624292736 00000100:00100000:2.0:1783951545.722770:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624292736 00000100:00100000:2.0:1783951545.722798:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951545.722804:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624292736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951545.722852:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624292736:12345-0@lo:400:kworker.0 Request processed in 47us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951545.722858:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1783951545.722873:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951545.722886:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624292736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951546.201554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951546.201638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951546.201670:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602242560 00000100:00100000:0.0:1783951546.201690:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602242560 00000100:00100000:0.0:1783951546.201758:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1783951546.201769:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2361:x1870608602242560:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951546.202072:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2361:x1870608602242560:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 303us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951546.202081:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00080000:0.0:1783951546.202105:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951546.202668:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602242432 00000100:00100000:3.0:1783951546.202740:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602242432 00000100:00100000:3.0:1783951546.202862:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:3.0:1783951546.203086:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2361:x1870608602242432:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951546.203147:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2361:x1870608602242432:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 64us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951546.203154:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:0.0:1783951546.207099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951546.207551:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602242688 00000100:00100000:3.0:1783951546.207563:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602242688 00000100:00100000:3.0:1783951546.207678:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1783951546.207701:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2357:x1870608602242688:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:3.0:1783951546.207746:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec360 00000100:00080000:3.0:1783951546.207756:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8d7fc6d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951546.207794:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783951546.208286:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+2:2357:x1870608602242688:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 587us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951546.208295:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00010000:00010000:3.0:1783951546.208897:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951546.208962:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951546.219571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951546.219659:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602242816 00000100:00100000:2.0:1783951546.219674:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602242816 00000100:00080000:0.0:1783951546.219850:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951546.220125:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1783951546.220140:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2357:x1870608602242816:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:2.0:1783951546.220421:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec367 00000100:00080000:2.0:1783951546.220435:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8e8d79d96000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951546.220477:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1783951546.220839:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951546.221581:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+2:2357:x1870608602242816:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 1440us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951546.221591:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1783951546.230103:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624292992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951546.230201:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951546.230317:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624292992 00000100:00100000:2.0:1783951546.230326:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624292992 00000100:00100000:2.0:1783951546.230375:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783951546.230384:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624292992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951546.230424:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951546.231348:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624292992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 960us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951546.231359:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1783951546.231532:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8121ea00 x1870608624292992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951546.231559:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624292992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783951546.627197:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783951546.688348:0:8916:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing yml_node 00010000:00010000:1.0:1783951547.640226:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783951548.338792:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:0.0:1783951548.338800:0:6615:0:(genops.c:906:class_export_put()) final put ffff8e8d7fc6b000/65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:1.0:1783951548.339062:0:477:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7fc6b000/65c652b5-a392-4c36-a8f6-f2bd53c90279 for lustre-OST0000 00000020:00000080:1.0:1783951548.339290:0:477:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d7fc6d800 for lustre-OST0000 00010000:00010000:3.0:1783951548.662109:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951549.687401:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951549.814211:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951549.814240:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624293120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951549.814332:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951549.815015:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624293120 00000100:00100000:2.0:1783951549.815028:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624293120 00000100:00100000:2.0:1783951549.815146:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951549.815157:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624293120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951549.815200:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951549.815284:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624293120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951549.815293:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1783951549.816095:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d5855ed80 x1870608624293120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951549.816119:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624293120:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783951549.816284:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1783951550.384159:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:0.0:1783951550.384177:0:7503:0:(genops.c:906:class_export_put()) final put ffff8e8d79d97800/65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:2.0:1783951550.384433:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d79d97800/65c652b5-a392-4c36-a8f6-f2bd53c90279 for lustre-OST0001 00000020:00000080:2.0:1783951550.384503:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d79d96000 for lustre-OST0001 00000001:02000400:2.0:1783951550.617640:0:9111:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:2.0:1783951550.710628:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951550.838227:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624293376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951550.838351:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951550.838427:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624293888:0@lo:400:kworker.0 00000100:00100000:3.0:1783951550.838460:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951550.838499:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951550.838506:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624293504:0@lo:400:kworker.0 00000100:00100000:3.0:1783951550.838531:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951550.838721:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624293376 00000100:00100000:3.0:1783951550.838731:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624293376 00000100:00100000:3.0:1783951550.838854:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624293504 00000100:00100000:3.0:1783951550.838858:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624293504 00000100:00100000:3.0:1783951550.838899:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783951550.838910:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624293376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951550.838984:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624293376:12345-0@lo:400:kworker.0 Request processed in 75us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951550.838993:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783951550.839015:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783951550.839022:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624293504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951550.839052:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624293504:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951550.839057:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783951550.839079:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624293888 00000100:00100000:3.0:1783951550.839083:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624293888 00000100:00100000:3.0:1783951550.839117:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951550.839123:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624293888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951550.839159:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624293888:12345-0@lo:400:kworker.0 Request processed in 36us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951550.839165:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1783951550.839192:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951550.839198:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951550.839243:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624293504:0@lo:400:kworker.0 00000100:00100000:2.0:1783951550.839367:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624293632:0@lo:400:kworker.0 00000100:00100000:2.0:1783951550.839410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951550.839438:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783951550.839445:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624293248:0@lo:400:kworker.0 00000100:00100000:2.0:1783951550.839481:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951550.839508:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624293760:0@lo:400:kworker.0 00000100:00100000:2.0:1783951550.839533:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951550.839576:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624293632 00000100:00100000:2.0:1783951550.839581:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624293632 00000100:00100000:2.0:1783951550.839611:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951550.839617:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624293632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951550.839654:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624293632:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951550.839659:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951550.839681:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624293248 00000100:00100000:2.0:1783951550.839685:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624293248 00000100:00100000:2.0:1783951550.839714:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783951550.839721:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624293248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951550.839752:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624293248:12345-0@lo:400:kworker.0 Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951550.839776:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783951550.839857:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624293248:0@lo:400:kworker.0 00010000:00080000:2.0:1783951550.839876:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db3100 x1870608624293632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951550.839888:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624293632:0@lo:400:kworker.0 00000100:00100000:2.0:1783951550.839917:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624293760 00000100:00100000:2.0:1783951550.839920:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624293760 00000100:00100000:2.0:1783951550.839954:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951550.839960:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624293760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951550.839993:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624293760:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951550.840000:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951550.840022:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624293760:0@lo:400:kworker.0 00000100:00080000:0.0:1783951550.840375:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951550.840430:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624293376:0@lo:400:kworker.0 00010000:00080000:3.0:1783951550.840445:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db1c00 x1870608624293888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951550.840456:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624293888:0@lo:400:kworker.0 00000100:00100000:1.0:1783951551.314286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951551.314371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951551.314527:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602242944 00000100:00100000:2.0:1783951551.314540:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602242944 00000100:00100000:2.0:1783951551.314616:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:2.0:1783951551.314630:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2359:x1870608602242944:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951551.314729:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2359:x1870608602242944:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951551.314738:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:3.0:1783951551.315421:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602243072 00000100:00100000:3.0:1783951551.315429:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602243072 00000100:00100000:2.0:1783951551.315686:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1783951551.315788:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602243072:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951551.315884:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602243072:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 191us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951551.315900:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00080000:3.0:1783951551.316425:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951551.359387:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951551.359420:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951551.359537:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951551.359728:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624294016 00000100:00100000:1.0:1783951551.359740:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624294016 00000100:00100000:1.0:1783951551.359834:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783951551.359853:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624294016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951551.359906:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951551.359958:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624294016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951551.359964:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1783951551.360008:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a7b80 x1870608624294016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951551.360027:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624294016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951551.739657:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951552.758655:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783951553.233303:0:9208:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:3.0:1783951553.786095:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951554.807564:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951554.936989:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624294144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951554.937117:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951554.937362:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624294144 00000100:00100000:3.0:1783951554.937371:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624294144 00000100:00100000:3.0:1783951554.937438:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783951554.937448:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624294144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951554.937484:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951554.937527:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624294144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951554.937534:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1783951554.937574:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af2680 x1870608624294144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951554.937604:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624294144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783951554.937945:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1783951555.507904:0:9307:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:1.0:1783951555.830089:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951555.958143:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624294272:0@lo:400:kworker.0 00000100:00100000:3.0:1783951555.958232:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951555.958419:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624294272 00000100:00100000:1.0:1783951555.958428:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624294272 00000100:00100000:1.0:1783951555.958479:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783951555.958487:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624294272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.958974:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624294656:0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.959014:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951555.959075:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624294400:0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.959128:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951555.959151:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951555.959157:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624294528:0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.959178:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951555.959231:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624294400 00000100:00100000:0.0:1783951555.959235:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624294400 00000100:00100000:0.0:1783951555.959275:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624294528 00000100:00100000:0.0:1783951555.959285:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624294528 00000100:00100000:0.0:1783951555.959317:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951555.959324:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624294400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.959364:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624294400:12345-0@lo:400:kworker.0 Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951555.959372:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951555.959389:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951555.959395:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624294528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.959420:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624294528:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951555.959426:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951555.959463:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624294528:0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.959472:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624294400:0@lo:400:kworker.0 00000100:00080000:0.0:1783951555.959502:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951555.959521:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624294656 00000100:00100000:0.0:1783951555.959524:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624294656 00000100:00100000:0.0:1783951555.959546:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951555.959551:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624294656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.959580:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624294656:12345-0@lo:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951555.959585:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1783951555.959605:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af0700 x1870608624294656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951555.959615:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624294656:0@lo:400:kworker.0 00000100:00100000:1.0:1783951555.960232:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624294272:12345-0@lo:400:kworker.0 Request processed in 1742us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951555.960243:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783951555.961154:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624294912:0@lo:400:kworker.0 00000100:00100000:1.0:1783951555.961267:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951555.961344:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624294912 00000100:00100000:2.0:1783951555.961352:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624294912 00000100:00100000:2.0:1783951555.961399:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783951555.961407:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624294912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951555.961449:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624294912:12345-0@lo:400:kworker.0 Request processed in 43us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951555.961455:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951555.961514:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951555.961534:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624294784:0@lo:400:kworker.0 00000100:00100000:0.0:1783951555.961560:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951555.961626:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624294784 00000100:00100000:2.0:1783951555.961630:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624294784 00000100:00100000:2.0:1783951555.961664:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783951555.961670:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624294784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951555.961701:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624294784:12345-0@lo:400:kworker.0 Request processed in 31us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951555.961707:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783951555.961895:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624294784:0@lo:400:kworker.0 00000100:00080000:1.0:1783951555.962139:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951555.962144:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783951555.962162:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af3800 x1870608624294912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951555.962172:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624294912:0@lo:400:kworker.0 00000100:00100000:3.0:1783951555.962678:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624294272:0@lo:400:kworker.0 00000100:00100000:1.0:1783951556.433685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951556.433839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951556.433883:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602243200 00000100:00100000:2.0:1783951556.433893:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602243200 00000100:00100000:2.0:1783951556.433956:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 198 00000100:00100000:2.0:1783951556.433968:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602243200:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951556.434270:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602243200:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 304us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951556.434279:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 198 00000100:00100000:0.0:1783951556.439672:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602243328 00000100:00100000:0.0:1783951556.439689:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602243328 00000100:00100000:2.0:1783951556.439877:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:2.0:1783951556.439889:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602243328:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951556.439983:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602243328:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 97us (6308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951556.439992:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00080000:1.0:1783951556.440153:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951556.470186:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624295040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951556.470265:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951556.470536:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624295040 00000100:00100000:3.0:1783951556.470544:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624295040 00000100:00100000:3.0:1783951556.470597:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783951556.470606:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624295040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951556.470645:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951556.471919:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624295040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1309us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951556.471942:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1783951556.478627:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a7480 x1870608624295040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951556.478657:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624295040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783951556.854760:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951556.998881:0:9356:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 10:05:55 EDT 2026 00010000:00010000:3.0:1783951557.879286:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951558.902380:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951559.928180:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951560.060082:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951560.066983:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624295168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951560.067114:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951560.070935:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624295168 00000100:00100000:3.0:1783951560.070958:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624295168 00000100:00100000:3.0:1783951560.071080:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951560.071096:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624295168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951560.071161:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951560.071274:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624295168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951560.071283:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783951560.071353:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af2a00 x1870608624295168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951560.071383:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624295168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783951560.071455:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951560.950930:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951561.081638:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624295296:0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.081747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951561.081901:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624295296 00000100:00100000:0.0:1783951561.081912:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624295296 00000100:00100000:0.0:1783951561.081994:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783951561.082005:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624295296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951561.086819:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624295296:12345-0@lo:400:kworker.0 Request processed in 4787us (5043us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951561.086840:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783951561.086933:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624295424:0@lo:400:kworker.0 00000100:00100000:1.0:1783951561.087195:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624295552:0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.087514:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624295296:0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.087538:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624295808:0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.087586:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951561.087622:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624295808 00000100:00100000:2.0:1783951561.087627:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624295808 00000100:00100000:2.0:1783951561.087692:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783951561.087702:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624295808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951561.087739:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951561.087757:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624295808:12345-0@lo:400:kworker.0 Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951561.087767:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951561.087770:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624295936:0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.087787:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624295424 00000100:00100000:2.0:1783951561.087790:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624295424 00000100:00100000:2.0:1783951561.087843:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783951561.087849:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624295424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.087880:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624295424:12345-0@lo:400:kworker.0 Request processed in 31us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951561.087886:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1783951561.087906:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951561.087952:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624295808:0@lo:400:kworker.0 00000100:00100000:0.0:1783951561.088068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951561.088082:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951561.088090:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624295680:0@lo:400:kworker.0 00000100:00100000:0.0:1783951561.088095:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624295424:0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.088129:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951561.088214:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951561.088247:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624295552 00000100:00100000:1.0:1783951561.088258:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624295552 00000100:00100000:1.0:1783951561.088311:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951561.088329:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624295552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951561.088366:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624295552:12345-0@lo:400:kworker.0 Request processed in 39us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951561.088373:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1783951561.088390:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951561.088410:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624295552:0@lo:400:kworker.0 00000100:00100000:0.0:1783951561.088652:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624295936 00000100:00100000:0.0:1783951561.088657:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624295936 00000100:00100000:2.0:1783951561.088702:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624295680 00000100:00100000:2.0:1783951561.088706:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624295680 00000100:00100000:2.0:1783951561.088739:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951561.088746:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624295680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951561.088746:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951561.088752:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624295936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.088783:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624295680:12345-0@lo:400:kworker.0 Request processed in 38us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951561.088786:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624295936:12345-0@lo:400:kworker.0 Request processed in 34us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951561.088790:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783951561.088798:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783951561.088843:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81339180 x1870608624295936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783951561.088856:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d757a5180 x1870608624295680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951561.088856:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624295936:0@lo:400:kworker.0 00000100:00100000:2.0:1783951561.088865:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624295680:0@lo:400:kworker.0 00000100:00080000:1.0:1783951561.088913:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951561.554330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951561.554400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951561.554552:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602243456 00000100:00100000:3.0:1783951561.554563:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602243456 00000100:00100000:3.0:1783951561.554627:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:3.0:1783951561.554639:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602243456:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951561.554726:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602243456:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951561.554734:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:2.0:1783951561.556472:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602243584 00000100:00100000:2.0:1783951561.556484:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602243584 00000100:00100000:2.0:1783951561.556590:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:2.0:1783951561.556609:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602243584:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951561.556692:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602243584:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 93us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951561.556700:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00080000:1.0:1783951561.557210:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951561.590168:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624296064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951561.590247:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951561.590451:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624296064 00000100:00100000:3.0:1783951561.590460:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624296064 00000100:00100000:3.0:1783951561.590516:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951561.590526:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624296064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951561.590584:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951561.590633:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624296064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951561.590640:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1783951561.590705:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8133b480 x1870608624296064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951561.590724:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624296064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951561.975030:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951563.002883:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951564.022071:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951565.047033:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951565.179939:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624296192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951565.180013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951565.180071:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624296192 00000100:00100000:3.0:1783951565.180077:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624296192 00000100:00100000:3.0:1783951565.180130:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951565.180139:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624296192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951565.180171:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951565.180217:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624296192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951565.180224:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1783951565.180245:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783951565.180270:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db1c00 x1870608624296192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951565.180285:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624296192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951566.075666:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951566.199075:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624296320:0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.199168:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951566.199224:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624296832:0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.199251:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951566.199289:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951566.199297:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624296704:0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.199323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951566.199373:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624296320 00000100:00100000:2.0:1783951566.199380:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624296320 00000100:00100000:2.0:1783951566.199427:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783951566.199438:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624296320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.199490:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624296320:12345-0@lo:400:kworker.0 Request processed in 53us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951566.199497:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783951566.199533:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624296832 00000100:00100000:2.0:1783951566.199548:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624296832 00000100:00100000:2.0:1783951566.199598:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951566.199606:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624296832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.199639:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624296832:12345-0@lo:400:kworker.0 Request processed in 34us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951566.199651:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951566.199669:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624296704 00000100:00100000:2.0:1783951566.199674:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624296704 00000100:00100000:2.0:1783951566.199699:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783951566.199706:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624296704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.199739:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624296704:12345-0@lo:400:kworker.0 Request processed in 34us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951566.199746:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783951566.199783:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81338380 x1870608624296704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951566.199797:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624296704:0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.199807:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624296320:0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.199934:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624296832:0@lo:400:kworker.0 00000100:00100000:3.0:1783951566.200506:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624296576:0@lo:400:kworker.0 00000100:00100000:1.0:1783951566.200798:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624296448:0@lo:400:kworker.0 00000100:00080000:2.0:1783951566.200869:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951566.200938:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951566.201758:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951566.201992:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624296960:0@lo:400:kworker.0 00000100:00100000:1.0:1783951566.202038:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951566.202887:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624296576 00000100:00100000:2.0:1783951566.202896:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624296576 00000100:00100000:2.0:1783951566.202956:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624296448 00000100:00100000:2.0:1783951566.202960:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624296448 00000100:00100000:2.0:1783951566.202987:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951566.202998:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624296576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.203683:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624296576:12345-0@lo:400:kworker.0 Request processed in 684us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951566.203693:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951566.203718:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783951566.203728:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624296448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951566.203733:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624296576:0@lo:400:kworker.0 00000100:00100000:2.0:1783951566.203787:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624296448:12345-0@lo:400:kworker.0 Request processed in 61us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951566.203796:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783951566.203801:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624296448:0@lo:400:kworker.0 00000100:00080000:2.0:1783951566.203844:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951566.205948:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624296960 00000100:00100000:0.0:1783951566.205959:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624296960 00000100:00100000:0.0:1783951566.206062:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783951566.206072:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624296960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951566.206151:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624296960:12345-0@lo:400:kworker.0 Request processed in 81us (4114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951566.206159:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1783951566.206202:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8133bb80 x1870608624296960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951566.206238:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624296960:0@lo:400:kworker.0 00000100:00080000:2.0:1783951566.206421:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951566.673226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951566.673304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951566.673368:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602243840 00000100:00100000:2.0:1783951566.673377:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602243840 00000100:00100000:2.0:1783951566.673450:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1783951566.673462:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2361:x1870608602243840:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:0.0:1783951566.673602:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951566.673704:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2361:x1870608602243840:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 244us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951566.673713:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:1.0:1783951566.674020:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602243712 00000100:00100000:1.0:1783951566.674026:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602243712 00000100:00100000:1.0:1783951566.674092:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:1.0:1783951566.674100:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2361:x1870608602243712:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951566.674142:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2361:x1870608602243712:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 43us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951566.674149:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:0.0:1783951566.715103:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624297088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951566.715179:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951566.715691:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624297088 00000100:00100000:0.0:1783951566.715700:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624297088 00000100:00100000:0.0:1783951566.715791:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951566.715802:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624297088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951566.715863:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951566.715921:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624297088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951566.715929:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1783951566.715994:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8133a300 x1870608624297088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951566.716015:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624297088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783951567.101896:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951568.118777:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951569.144516:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951570.166616:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951570.294010:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951570.294045:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624297216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951570.294113:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951570.294151:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624297216 00000100:00100000:2.0:1783951570.294159:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624297216 00000100:00080000:3.0:1783951570.294185:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951570.294210:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951570.294220:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624297216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951570.294260:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951570.294610:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624297216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 390us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951570.294619:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1783951570.295256:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db3800 x1870608624297216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951570.295279:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624297216:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1783951571.129739:0:9985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:06:10 (1783951570) === 00010000:00010000:2.0:1783951571.191156:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951571.319981:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624297472:0@lo:400:kworker.0 00000100:00100000:0.0:1783951571.320060:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951571.320116:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624297984:0@lo:400:kworker.0 00000100:00100000:0.0:1783951571.320140:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951571.320161:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951571.320166:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624297600:0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.320180:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624297344:0@lo:400:kworker.0 00000100:00100000:0.0:1783951571.320188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951571.320235:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951571.320268:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624297856:0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.320292:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951571.320311:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951571.320317:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624297728:0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.320340:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951571.320371:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624297472 00000100:00100000:1.0:1783951571.320378:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624297472 00000100:00100000:1.0:1783951571.320419:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624297600 00000100:00100000:1.0:1783951571.320423:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624297600 00000100:00100000:1.0:1783951571.320442:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624297856 00000100:00100000:1.0:1783951571.320445:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624297856 00000100:00100000:1.0:1783951571.320460:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783951571.320468:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624297472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.320532:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624297472:12345-0@lo:400:kworker.0 Request processed in 64us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.320540:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783951571.320556:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783951571.320562:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624297600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.320587:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624297600:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.320593:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783951571.320603:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783951571.320609:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624297856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.320636:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624297856:12345-0@lo:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.320652:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783951571.320670:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624297344 00000100:00100000:1.0:1783951571.320674:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624297344 00000100:00100000:1.0:1783951571.320695:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783951571.320701:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624297344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.320730:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624297344:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.320737:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783951571.320779:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624297984 00000100:00100000:1.0:1783951571.320782:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624297984 00000100:00100000:1.0:1783951571.320805:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624297728 00000100:00100000:1.0:1783951571.320828:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624297728 00000100:00100000:1.0:1783951571.320857:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951571.320864:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624297984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.321297:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624297984:12345-0@lo:400:kworker.0 Request processed in 432us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.321305:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951571.321319:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951571.321326:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624297728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.321355:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624297728:12345-0@lo:400:kworker.0 Request processed in 31us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.321361:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1783951571.321381:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951571.321385:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783951571.321420:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8133aa00 x1870608624297728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951571.321450:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624297728:0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.321460:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624297344:0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.321469:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624297856:0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.321514:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624297600:0@lo:400:kworker.0 00010000:00080000:1.0:1783951571.321527:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8133a300 x1870608624297984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951571.321535:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624297984:0@lo:400:kworker.0 00000100:00100000:1.0:1783951571.321544:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624297472:0@lo:400:kworker.0 00000100:00100000:0.0:1783951571.797143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951571.797204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.797316:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602244096 00000100:00100000:1.0:1783951571.797326:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602244096 00000100:00100000:1.0:1783951571.797406:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:1.0:1783951571.797416:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602244096:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951571.797521:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602244096:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 78us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.797529:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00080000:3.0:1783951571.797726:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951571.798413:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602243968 00000100:00100000:2.0:1783951571.798435:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602243968 00000100:00100000:2.0:1783951571.798483:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:2.0:1783951571.798501:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602243968:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951571.798557:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602243968:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 66us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951571.798564:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:0.0:1783951571.830765:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951571.830799:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624298112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951571.830888:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951571.831186:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624298112 00000100:00100000:3.0:1783951571.831195:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624298112 00000100:00100000:3.0:1783951571.831249:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783951571.831260:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624298112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951571.831298:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951571.831355:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624298112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951571.831362:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783951571.831409:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81339500 x1870608624298112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951571.831426:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624298112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951571.862596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.862833:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602244224 00000100:00100000:1.0:1783951571.862845:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602244224 00000100:00100000:1.0:1783951571.862911:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 205 00000100:00100000:1.0:1783951571.862929:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:8112:x1870608602244224:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951571.862947:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951571.862967:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d60d5e200/0x443dabd358eec42b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a03855d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951571.863396:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d60d5e200/0x443dabd358eec42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03855d expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951571.863408:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d60d5e200/0x443dabd358eec42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03855d expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951571.863417:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5e200, rc 0) 00000100:00100000:1.0:1783951571.863482:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8112:x1870608602244224:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 561us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.863498:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 205 00000100:00100000:0.0:1783951571.871448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.871552:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602244352 00000100:00100000:1.0:1783951571.871562:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602244352 00000100:00100000:1.0:1783951571.871619:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:1.0:1783951571.871630:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8112:x1870608602244352:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783951571.872069:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8112:x1870608602244352:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 440us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.872078:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:0.0:1783951571.877983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.878133:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602244480 00000100:00100000:1.0:1783951571.878143:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602244480 00000100:00100000:1.0:1783951571.878196:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 207 00000100:00100000:1.0:1783951571.878207:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8112:x1870608602244480:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783951571.878450:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8112:x1870608602244480:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 243us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.878458:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 207 00000100:00100000:0.0:1783951571.882440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.882645:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602244608 00000100:00100000:1.0:1783951571.882669:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602244608 00000100:00100000:1.0:1783951571.882783:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:1.0:1783951571.882794:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8116:x1870608602244608:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951571.883221:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8116:x1870608602244608:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 426us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.883229:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:0.0:1783951571.917063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.917295:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602244736 00000100:00100000:1.0:1783951571.917307:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602244736 00000100:00100000:1.0:1783951571.917372:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:1.0:1783951571.917384:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8116:x1870608602244736:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951571.917741:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8116:x1870608602244736:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 358us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.917750:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:0.0:1783951571.924959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.925347:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602244864 00000100:00100000:1.0:1783951571.925358:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602244864 00000100:00100000:1.0:1783951571.925635:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:1.0:1783951571.925647:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:8112:x1870608602244864:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951571.925664:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951571.925684:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d60d5e800/0x443dabd358eec432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038587 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951571.925715:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d60d5e800/0x443dabd358eec432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038587 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951571.925726:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d60d5e800/0x443dabd358eec432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038587 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951571.925746:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5e800, rc 0) 00000100:00100000:1.0:1783951571.925852:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:8112:x1870608602244864:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 206us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.925859:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:1.0:1783951571.937681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.937725:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602244992 00000100:00100000:1.0:1783951571.937736:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602244992 00000100:00100000:1.0:1783951571.937802:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:1.0:1783951571.937834:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:8112:x1870608602244992:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783951571.937866:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783951571.937893:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783951571.937897:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783951571.937900:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783951571.937902:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783951571.941188:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:8112:x1870608602244992:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 3366us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.941203:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:1.0:1783951571.943756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951571.950367:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602245120 00000100:00100000:2.0:1783951571.950384:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602245120 00000100:00100000:0.0:1783951571.954477:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:0.0:1783951571.954503:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:8112:x1870608602245120:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783951571.954523:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951571.954552:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a03858e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951571.954583:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951571.954595:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951571.954603:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4800, rc 0) 00000100:00100000:0.0:1783951571.954675:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8112:x1870608602245120:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 185us (10927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951571.954682:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:0.0:1783951571.957755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.957895:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602245248 00000100:00100000:1.0:1783951571.957904:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602245248 00000100:00100000:1.0:1783951571.957997:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:1.0:1783951571.958004:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8112:x1870608602245248:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783951571.958372:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8112:x1870608602245248:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 368us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.958378:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:3.0:1783951571.961385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951571.962138:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602245376 00000100:00100000:2.0:1783951571.962148:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602245376 00000100:00100000:2.0:1783951571.962226:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:2.0:1783951571.962238:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8112:x1870608602245376:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783951571.962501:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8112:x1870608602245376:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 265us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951571.962509:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:3.0:1783951571.964539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951571.964719:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602245504 00000100:00100000:0.0:1783951571.964728:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602245504 00000100:00100000:0.0:1783951571.964782:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:0.0:1783951571.964792:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8118:x1870608602245504:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951571.965127:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8118:x1870608602245504:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 337us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951571.965136:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:0.0:1783951571.967747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.967853:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602245632 00000100:00100000:1.0:1783951571.967862:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602245632 00000100:00100000:1.0:1783951571.967916:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:1.0:1783951571.967926:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8118:x1870608602245632:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951571.968186:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:8118:x1870608602245632:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 261us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.968195:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:3.0:1783951571.972255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.972305:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602245760 00000100:00100000:1.0:1783951571.972317:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602245760 00000100:00100000:1.0:1783951571.972412:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1783951571.972430:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2357:x1870608602245760:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783951571.972465:0:8068:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a5168f61-b22b-4094-aa34-e52db03426e1@192.168.201.6@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:1.0:1783951571.972514:0:8068:0:(genops.c:1406:class_connect()) connect: client a5168f61-b22b-4094-aa34-e52db03426e1, cookie 0x443dabd358eec440 00000004:00100000:1.0:1783951571.972563:0:8068:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783951571.972945:0:8068:0:(import.c:65:import_set_state_nolock()) ffff8e8d75770800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951571.973020:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+6:2357:x1870608602245760:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 599us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.973029:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1783951571.980358:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951571.980404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.980513:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602245888 00000100:00100000:1.0:1783951571.980523:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602245888 00000100:00100000:1.0:1783951571.980597:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602246016 00000100:00100000:1.0:1783951571.980601:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602246016 00000100:00100000:1.0:1783951571.980628:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1783951571.980639:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+7:0:x1870608602245888:12345-192.168.201.6@tcp:41:mount.lustre.0 00000100:00100000:0.0:1783951571.980660:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1783951571.980670:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+7:8112:x1870608602246016:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783951571.980702:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1783951571.980837:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1783951571.980917:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783951571.980996:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+7:8112:x1870608602246016:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 326us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951571.981004:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:1.0:1783951571.981981:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+6:0:x1870608602245888:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 1341us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.983859:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1783951571.992269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951571.992380:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602246144 00000100:00100000:1.0:1783951571.992390:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602246144 00000100:00100000:1.0:1783951571.992515:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1783951571.992527:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+6:8112:x1870608602246144:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783951571.992630:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+6:8112:x1870608602246144:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 105us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951571.992638:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1783951571.994334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951571.994475:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602246528 00000100:00100000:2.0:1783951571.994482:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602246528 00000100:00100000:2.0:1783951571.994540:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1783951571.994550:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5168f61-b22b-4094-aa34-e52db03426e1+6:8112:x1870608602246528:12345-192.168.201.6@tcp:33:mount.lustre.0 00000100:00100000:0.0:1783951571.994899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951571.995088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951571.995266:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602246272 00000100:00100000:3.0:1783951571.995271:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602246272 00000004:00200000:2.0:1783951571.995291:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1783951571.995300:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602246400 00000100:00100000:3.0:1783951571.995302:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602246400 00000100:00100000:3.0:1783951571.995321:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1783951571.995327:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1870608602246272:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783951571.995349:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a5168f61-b22b-4094-aa34-e52db03426e1@192.168.201.6@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:3.0:1783951571.995381:0:6590:0:(genops.c:1406:class_connect()) connect: client a5168f61-b22b-4094-aa34-e52db03426e1, cookie 0x443dabd358eec447 00002000:00100000:3.0:1783951571.995393:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a5168f61-b22b-4094-aa34-e52db03426e1/ffff8e8d5844e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783951571.995409:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783951571.995429:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5168f61-b22b-4094-aa34-e52db03426e1+6:8112:x1870608602246528:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 881us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951571.995437:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1783951571.995478:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1783951571.995482:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1870608602246400:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783951571.995544:0:8067:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a5168f61-b22b-4094-aa34-e52db03426e1@192.168.201.6@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1783951571.995570:0:8067:0:(genops.c:1406:class_connect()) connect: client a5168f61-b22b-4094-aa34-e52db03426e1, cookie 0x443dabd358eec44e 00002000:00100000:2.0:1783951571.995575:0:8067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a5168f61-b22b-4094-aa34-e52db03426e1/ffff8e8d757b9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951571.995582:0:8067:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783951571.995658:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783951571.995689:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8e8d5844f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951571.995723:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+6:2357:x1870608602246272:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 395us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951571.995730:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00002000:00080000:3.0:1783951571.999251:0:8067:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783951571.999302:0:8067:0:(import.c:65:import_set_state_nolock()) ffff8e8d5844a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951571.999380:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5168f61-b22b-4094-aa34-e52db03426e1+6:2357:x1870608602246400:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 3893us (4289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951571.999392:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00010000:00010000:1.0:1783951572.213979:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951573.242966:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783951573.926637:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5168f61-b22b-4094-aa34-e52db03426e1 00010000:00010000:1.0:1783951574.261970:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951575.286201:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951575.414222:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951575.414248:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624298240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951575.414328:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951575.414699:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624298240 00000100:00100000:3.0:1783951575.414709:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624298240 00000100:00100000:3.0:1783951575.415140:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783951575.415150:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624298240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951575.415190:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951575.415271:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624298240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951575.415279:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1783951575.415322:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db2300 x1870608624298240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951575.415342:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624298240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783951575.415575:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1783951575.972208:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a5168f61-b22b-4094-aa34-e52db03426e1 00000001:00100000:1.0:1783951575.983907:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5168f61-b22b-4094-aa34-e52db03426e1 00010000:00010000:2.0:1783951576.315976:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951576.438295:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624298368:0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.438295:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624298496:0@lo:400:kworker.0 00000100:00100000:2.0:1783951576.438374:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624298752:0@lo:400:kworker.0 00000100:00100000:1.0:1783951576.440674:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951576.440735:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624298880:0@lo:400:kworker.0 00000100:00100000:1.0:1783951576.440769:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951576.442733:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951576.442782:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624299008:0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.442843:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951576.442885:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951576.442893:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624298624:0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.442920:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951576.442966:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624298880 00000100:00100000:0.0:1783951576.442974:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624298880 00000100:00100000:0.0:1783951576.443035:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624298496 00000100:00100000:0.0:1783951576.443039:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624298496 00000100:00100000:0.0:1783951576.443258:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624298624 00000100:00100000:0.0:1783951576.443261:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624298624 00000100:00100000:0.0:1783951576.443279:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783951576.443287:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624298880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.443344:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624298880:12345-0@lo:400:kworker.0 Request processed in 57us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951576.443351:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783951576.443478:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783951576.443488:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624298496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.443522:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624298496:12345-0@lo:400:kworker.0 Request processed in 37us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951576.443529:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783951576.443540:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783951576.443546:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624298624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.443569:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624298624:12345-0@lo:400:kworker.0 Request processed in 23us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951576.443575:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783951576.443663:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624299008 00000100:00100000:0.0:1783951576.443666:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624299008 00000100:00100000:0.0:1783951576.443692:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783951576.443698:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624299008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.443991:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624299008:12345-0@lo:400:kworker.0 Request processed in 292us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951576.443998:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1783951576.444014:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951576.444018:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951576.444053:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624298880:0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.444167:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624298624:0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.444298:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624298496:0@lo:400:kworker.0 00010000:00080000:0.0:1783951576.444314:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d502d7b80 x1870608624299008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951576.444326:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624299008:0@lo:400:kworker.0 00000100:00100000:2.0:1783951576.445786:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951576.447210:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624298368 00000100:00100000:2.0:1783951576.447221:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624298368 00000100:00100000:2.0:1783951576.447270:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783951576.447280:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624298368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951576.447357:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624298368:12345-0@lo:400:kworker.0 Request processed in 79us (6690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951576.447364:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1783951576.447957:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624298752 00000100:00100000:0.0:1783951576.447965:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624298752 00000100:00100000:0.0:1783951576.447998:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783951576.448004:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624298752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951576.448047:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624298752:12345-0@lo:400:kworker.0 Request processed in 43us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951576.448052:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783951576.448094:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624298368:0@lo:400:kworker.0 00010000:00080000:2.0:1783951576.448232:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d502d4380 x1870608624298752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951576.448244:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624298752:0@lo:400:kworker.0 00000001:02000400:3.0:1783951576.914006:0:10185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1783951576.950360:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951576.950386:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624299136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951576.950466:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951576.950848:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624299136 00000100:00100000:1.0:1783951576.950856:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624299136 00000100:00100000:1.0:1783951576.950998:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951576.951013:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624299136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951576.951057:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951576.951108:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624299136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (642us total) trans 0 rc 0/0 00010000:00080000:0.0:1783951576.958546:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8133b800 x1870608624299136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951576.958580:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624299136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951576.960092:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1783951577.335914:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951577.429068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951577.429177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951577.429217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951577.429247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951577.429295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951577.429320:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602246912 00000100:00100000:0.0:1783951577.429320:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602246784 00000100:00100000:2.0:1783951577.429329:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602246912 00000100:00100000:0.0:1783951577.429329:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602246784 00000100:00100000:3.0:1783951577.429389:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602247168 00000100:00100000:3.0:1783951577.429401:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602247168 00000100:00100000:0.0:1783951577.429468:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:3.0:1783951577.431939:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602247040 00000100:00100000:3.0:1783951577.431950:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602247040 00000100:00100000:3.0:1783951577.431986:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1783951577.431996:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247168:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951577.432073:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247168:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 78us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951577.432081:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1783951577.432097:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1783951577.432104:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247040:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951577.432128:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247040:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951577.432134:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00080000:3.0:1783951577.432309:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951577.432313:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951577.432317:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951577.432512:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602246656 00000100:00100000:1.0:1783951577.432517:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602246656 00000100:00100000:1.0:1783951577.432551:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:1.0:1783951577.432559:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602246656:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951577.432594:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602246656:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951577.432601:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:0.0:1783951577.432761:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602246784:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951577.432871:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602246784:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 3394us (3622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951577.432878:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:2.0:1783951577.434352:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:2.0:1783951577.434365:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602246912:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951577.434436:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602246912:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 74us (5258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951577.434444:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00010000:00010000:1.0:1783951578.359271:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951579.387192:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951580.406765:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951580.534833:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951580.534928:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624299264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951580.535009:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951580.535140:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624299264 00000100:00100000:3.0:1783951580.535149:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624299264 00000100:00100000:3.0:1783951580.535222:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951580.535234:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624299264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951580.535274:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951580.535324:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624299264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951580.535362:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1783951580.535401:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d502d5c00 x1870608624299264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951580.535421:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624299264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783951580.537298:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951581.431353:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951581.558208:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624299648:0@lo:400:kworker.0 00000100:00100000:2.0:1783951581.558283:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951581.558345:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783951581.558350:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624299520:0@lo:400:kworker.0 00000100:00100000:2.0:1783951581.558366:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951581.558378:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624300032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951581.558400:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951581.558437:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624299648 00000100:00100000:2.0:1783951581.558445:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624299648 00000100:00100000:2.0:1783951581.558498:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624299520 00000100:00100000:2.0:1783951581.558501:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624299520 00000100:00100000:2.0:1783951581.558530:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783951581.558540:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624299648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951581.558592:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624299648:12345-0@lo:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951581.558599:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783951581.558615:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783951581.558621:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624299520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951581.558648:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624299520:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951581.558654:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783951581.558672:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624300032 00000100:00100000:2.0:1783951581.558675:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624300032 00000100:00100000:2.0:1783951581.558706:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951581.558712:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624300032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951581.558741:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624300032:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951581.558762:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1783951581.558777:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951581.558781:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951581.558851:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624299520:0@lo:400:kworker.0 00010000:00080000:2.0:1783951581.558866:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af1500 x1870608624300032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951581.558962:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624300032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951581.558975:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624299648:0@lo:400:kworker.0 00000100:00100000:3.0:1783951581.559108:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624299392:0@lo:400:kworker.0 00000100:00100000:3.0:1783951581.559136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951581.559161:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624299904:0@lo:400:kworker.0 00000100:00100000:3.0:1783951581.559174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951581.559191:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951581.559195:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624299776:0@lo:400:kworker.0 00000100:00100000:3.0:1783951581.559208:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951581.559224:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624299904 00000100:00100000:3.0:1783951581.559226:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624299904 00000100:00100000:3.0:1783951581.559243:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783951581.559247:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624299904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951581.559269:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624299904:12345-0@lo:400:kworker.0 Request processed in 22us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951581.559273:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783951581.559284:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624299776 00000100:00100000:3.0:1783951581.559286:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624299776 00000100:00100000:3.0:1783951581.559304:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783951581.559310:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624299776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951581.559350:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624299776:12345-0@lo:400:kworker.0 Request processed in 40us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951581.559356:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1783951581.559389:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af1c00 x1870608624299776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951581.559399:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624299776:0@lo:400:kworker.0 00000100:00100000:3.0:1783951581.559410:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624299904:0@lo:400:kworker.0 00000100:00100000:1.0:1783951581.559475:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624299392 00000100:00100000:1.0:1783951581.559478:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624299392 00000100:00100000:1.0:1783951581.559511:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783951581.559518:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624299392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951581.559554:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624299392:12345-0@lo:400:kworker.0 Request processed in 37us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951581.559560:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783951581.559592:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624299392:0@lo:400:kworker.0 00000100:00080000:2.0:1783951581.559739:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951582.071710:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951582.071740:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624300160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951582.071891:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951582.071969:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624300160 00000100:00100000:3.0:1783951582.071978:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624300160 00000100:00100000:3.0:1783951582.072039:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783951582.072050:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624300160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951582.072088:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951582.072140:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624300160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951582.072149:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1783951582.072166:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81445f80 x1870608624300160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951582.072188:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624300160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951582.459353:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951582.547006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951582.547050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951582.547154:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602247424 00000100:00100000:2.0:1783951582.547165:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602247424 00000100:00100000:2.0:1783951582.547229:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:2.0:1783951582.547241:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602247424:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951582.547325:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602247424:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951582.547343:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00080000:2.0:1783951582.547367:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951582.548479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951582.548503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951582.548541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951582.548603:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602247296 00000100:00100000:2.0:1783951582.548611:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602247296 00000100:00100000:2.0:1783951582.548650:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 220 00000100:00100000:2.0:1783951582.548657:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602247296:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951582.548702:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602247296:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951582.548709:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 220 00000100:00100000:2.0:1783951582.548758:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602247552 00000100:00100000:2.0:1783951582.548762:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602247552 00000100:00100000:2.0:1783951582.548832:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:2.0:1783951582.548839:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247552:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951582.548872:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247552:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 34us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951582.548878:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00080000:2.0:1783951582.548980:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951582.556976:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602247680 00000100:00100000:1.0:1783951582.556992:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602247680 00000100:00100000:1.0:1783951582.557067:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602247808 00000100:00100000:1.0:1783951582.557070:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602247808 00000100:00100000:1.0:1783951582.557096:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:1.0:1783951582.557106:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247680:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:3.0:1783951582.557181:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951582.557186:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951582.557283:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247680:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 178us (10231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951582.557301:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:1.0:1783951582.557326:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:1.0:1783951582.557332:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247808:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951582.557353:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602247808:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 22us (8813us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951582.557359:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00010000:00010000:1.0:1783951583.485986:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951584.502145:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951585.530469:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951585.654849:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624300288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951585.654935:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951585.655006:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624300288 00000100:00100000:0.0:1783951585.655015:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624300288 00000100:00100000:0.0:1783951585.655096:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783951585.655115:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624300288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951585.655160:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951585.655206:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624300288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951585.655214:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1783951585.655618:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783951585.655652:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81447100 x1870608624300288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951585.655674:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624300288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951586.550026:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951586.680345:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624300416:0@lo:400:kworker.0 00000100:00100000:1.0:1783951586.680442:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951586.680769:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624300416 00000100:00100000:0.0:1783951586.680777:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624300416 00000100:00100000:0.0:1783951586.680857:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783951586.680869:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624300416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951586.680974:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624300800:0@lo:400:kworker.0 00000100:00100000:2.0:1783951586.681013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951586.681053:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624300800 00000100:00100000:2.0:1783951586.681057:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624300800 00000100:00100000:2.0:1783951586.681087:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951586.681093:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624300800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951586.681130:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624300800:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951586.681138:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1783951586.681336:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d502d7800 x1870608624300800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951586.681371:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624300800:0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.681683:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624300672:0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.681724:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951586.681749:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783951586.681756:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624300544:0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.681777:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951586.681795:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624301056:0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.681848:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951586.681876:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624300672 00000100:00100000:3.0:1783951586.681881:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624300672 00000100:00100000:3.0:1783951586.681920:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624300544 00000100:00100000:3.0:1783951586.681923:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624300544 00000100:00100000:3.0:1783951586.681942:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783951586.681948:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624300672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.681995:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624300672:12345-0@lo:400:kworker.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951586.682002:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783951586.682015:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783951586.682021:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624300544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.682047:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624300544:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951586.682052:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783951586.682073:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624301056 00000100:00100000:3.0:1783951586.682076:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624301056 00000100:00100000:3.0:1783951586.682108:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783951586.682115:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624301056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.682144:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624301056:12345-0@lo:400:kworker.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951586.682149:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1783951586.682166:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951586.682171:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951586.682197:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624300544:0@lo:400:kworker.0 00010000:00080000:3.0:1783951586.682208:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d502d5880 x1870608624301056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951586.682217:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624301056:0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.682226:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624300672:0@lo:400:kworker.0 00000100:00100000:2.0:1783951586.682338:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951586.682348:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624300928:0@lo:400:kworker.0 00000100:00100000:2.0:1783951586.682378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951586.682510:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624300928 00000100:00100000:3.0:1783951586.682514:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624300928 00000100:00100000:3.0:1783951586.682552:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783951586.682566:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624300928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951586.682599:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624300928:12345-0@lo:400:kworker.0 Request processed in 34us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951586.682606:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1783951586.682687:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951586.682707:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624300928:0@lo:400:kworker.0 00000100:00100000:0.0:1783951586.683261:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624300416:12345-0@lo:400:kworker.0 Request processed in 2392us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951586.683272:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783951586.683406:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624300416:0@lo:400:kworker.0 00000100:00100000:3.0:1783951587.190436:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624301184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951587.190515:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951587.195033:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624301184 00000100:00100000:1.0:1783951587.195048:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624301184 00000100:00100000:1.0:1783951587.195191:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951587.195201:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624301184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951587.195253:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951587.198475:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624301184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3265us (7949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951587.198490:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1783951587.221364:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81446300 x1870608624301184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951587.221394:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624301184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951587.574146:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951587.665830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951587.665918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951587.666033:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602247936 00000100:00100000:2.0:1783951587.666044:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602247936 00000100:00100000:2.0:1783951587.666113:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 222 00000100:00100000:2.0:1783951587.666124:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602247936:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951587.666230:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602247936:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 98us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951587.666238:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 222 00000100:00100000:3.0:1783951587.666437:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602248064 00000100:00100000:3.0:1783951587.666442:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602248064 00000100:00080000:2.0:1783951587.666539:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951587.666589:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:3.0:1783951587.666597:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602248064:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951587.666647:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602248064:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 51us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951587.666653:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:0.0:1783951587.672046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951587.672127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951587.672163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951587.672203:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602248448 00000100:00100000:0.0:1783951587.672213:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602248448 00000100:00100000:1.0:1783951587.672253:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602248320 00000100:00100000:1.0:1783951587.672259:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602248320 00000100:00100000:0.0:1783951587.672290:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:0.0:1783951587.672306:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602248448:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951587.672385:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602248448:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951587.673669:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:1.0:1783951587.673684:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602248320:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:2.0:1783951587.673909:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951587.673915:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951587.674012:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602248320:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 333us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951587.674021:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1783951587.675890:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602248192 00000100:00100000:3.0:1783951587.675967:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602248192 00000100:00100000:0.0:1783951587.676356:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1783951587.677174:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:2.0:1783951587.677187:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602248192:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951587.677279:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602248192:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 95us (5244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951587.677295:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00080000:0.0:1783951587.677303:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783951588.608391:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951589.621991:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951590.652010:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951590.774150:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951590.774182:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624301312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951590.774257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951590.774401:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624301312 00000100:00100000:3.0:1783951590.774412:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624301312 00000100:00100000:3.0:1783951590.774475:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783951590.774487:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624301312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951590.774525:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951590.774568:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624301312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951590.774575:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1783951590.774672:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783951590.774750:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81444e00 x1870608624301312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951590.774771:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624301312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783951591.669948:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951591.770567:0:10886:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1783951591.798090:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624301440:0@lo:400:kworker.0 00000100:00100000:1.0:1783951591.798190:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951591.799230:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624301440 00000100:00100000:3.0:1783951591.799240:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624301440 00000100:00100000:3.0:1783951591.799296:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783951591.799377:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624301440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951591.801753:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624301824:0@lo:400:kworker.0 00000100:00100000:2.0:1783951591.801849:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951591.801916:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624301824 00000100:00100000:2.0:1783951591.801923:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624301824 00000100:00100000:2.0:1783951591.801974:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783951591.801982:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624301824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951591.802028:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624301824:12345-0@lo:400:kworker.0 Request processed in 46us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951591.802035:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1783951591.802074:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81447100 x1870608624301824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951591.802088:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624301824:0@lo:400:kworker.0 00000100:00100000:3.0:1783951591.805447:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624301440:12345-0@lo:400:kworker.0 Request processed in 6063us (7248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951591.805462:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783951591.805901:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624301568:0@lo:400:kworker.0 00000100:00100000:0.0:1783951591.805955:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951591.805977:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624302080:0@lo:400:kworker.0 00000100:00100000:0.0:1783951591.805998:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951591.806017:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951591.806022:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624301696:0@lo:400:kworker.0 00000100:00100000:0.0:1783951591.806041:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951591.806135:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624301568 00000100:00100000:0.0:1783951591.806142:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624301568 00000100:00100000:0.0:1783951591.806196:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624301696 00000100:00100000:0.0:1783951591.806200:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624301696 00000100:00100000:0.0:1783951591.806227:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783951591.806235:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624301568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951591.806279:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624301568:12345-0@lo:400:kworker.0 Request processed in 46us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951591.806286:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783951591.806423:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783951591.806432:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624301696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951591.806461:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624301696:12345-0@lo:400:kworker.0 Request processed in 31us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951591.806467:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783951591.806487:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624302080 00000100:00100000:0.0:1783951591.806490:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624302080 00000100:00100000:3.0:1783951591.806618:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951591.806627:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624301952:0@lo:400:kworker.0 00000100:00100000:3.0:1783951591.806655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951591.806676:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624301952 00000100:00100000:3.0:1783951591.806680:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624301952 00000100:00100000:3.0:1783951591.806697:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783951591.806703:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624301952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951591.806799:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624301952:12345-0@lo:400:kworker.0 Request processed in 95us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951591.806806:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783951591.806851:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624301952:0@lo:400:kworker.0 00000100:00100000:0.0:1783951591.806933:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951591.806940:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624302080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951591.806970:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624302080:12345-0@lo:400:kworker.0 Request processed in 31us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951591.806991:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1783951591.807009:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951591.807013:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951591.807029:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624301696:0@lo:400:kworker.0 00000100:00100000:0.0:1783951591.807039:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624301568:0@lo:400:kworker.0 00010000:00080000:0.0:1783951591.807050:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81444e00 x1870608624302080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951591.807060:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624302080:0@lo:400:kworker.0 00000100:00100000:1.0:1783951591.810747:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624301440:0@lo:400:kworker.0 00000100:00100000:2.0:1783951592.310518:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624302208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951592.310598:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951592.310849:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624302208 00000100:00100000:3.0:1783951592.310858:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624302208 00000100:00100000:3.0:1783951592.310910:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783951592.310920:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624302208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951592.310971:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951592.311029:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624302208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951592.311037:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1783951592.311552:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d76db1500 x1870608624302208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951592.311575:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624302208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783951592.698569:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951592.793900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951592.794161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951592.794196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951592.794226:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602248960 00000100:00100000:0.0:1783951592.794236:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602248960 00000100:00100000:0.0:1783951592.794310:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602249088 00000100:00100000:0.0:1783951592.794314:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602249088 00000100:00100000:0.0:1783951592.794339:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1783951592.794350:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2357:x1870608602248960:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:0.0:1783951592.794385:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec447 00000100:00080000:0.0:1783951592.794396:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8e8d5844f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951592.794439:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783951592.794852:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+2:2357:x1870608602248960:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 504us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951592.794859:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1783951592.794873:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1783951592.794877:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2357:x1870608602249088:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:0.0:1783951592.794902:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec44e 00000100:00080000:0.0:1783951592.794906:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8e8d5844a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951592.794923:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783951592.795046:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5168f61-b22b-4094-aa34-e52db03426e1+2:2357:x1870608602249088:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 167us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951592.795053:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00080000:0.0:1783951592.795070:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951592.795074:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783951592.795088:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951592.795143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951592.795218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:0.0:1783951592.795297:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951592.795307:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602248704 00000100:00100000:0.0:1783951592.795311:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602248704 00000100:00100000:0.0:1783951592.795337:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602248832 00000100:00100000:0.0:1783951592.795339:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602248832 00000100:00100000:0.0:1783951592.795351:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:0.0:1783951592.795355:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602248704:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951592.795380:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602248704:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951592.795385:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:0.0:1783951592.795392:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:0.0:1783951592.795396:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602248832:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951592.795408:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602248832:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 12us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951592.795412:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00080000:0.0:1783951592.795428:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951592.801732:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602248576 00000100:00100000:2.0:1783951592.801748:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602248576 00000100:00100000:2.0:1783951592.801826:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 224 00000100:00100000:2.0:1783951592.801838:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2358:x1870608602248576:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951592.801939:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2358:x1870608602248576:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 104us (8051us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951592.801947:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 224 00010000:00010000:2.0:1783951593.720915:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783951594.392395:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5168f61-b22b-4094-aa34-e52db03426e1 00000020:00000080:0.0:1783951594.392405:0:6615:0:(genops.c:906:class_export_put()) final put ffff8e8d5844e000/a5168f61-b22b-4094-aa34-e52db03426e1 00000020:00000080:2.0:1783951594.392472:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d5844e000/a5168f61-b22b-4094-aa34-e52db03426e1 for lustre-OST0000 00000020:00000080:2.0:1783951594.392519:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d5844f800 for lustre-OST0000 00000020:00000080:3.0:1783951594.737323:0:11035:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff915ef2b0 20000000:00000080:3.0:1783951594.737341:0:11035:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8d7f601400 uarg=0000000000000000 20000000:01000000:3.0:1783951594.737377:0:11035:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783951594.737388:0:11035:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783951594.737393:0:11035:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783951594.738370:0:11036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1783951594.738530:0:11035:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00010000:00010000:2.0:1783951594.744700:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783951594.745786:0:11035:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783951594.745950:0:11035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.745973:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.745982:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec401 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.745989:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec40f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.745997:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec41d expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.746004:0:11035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.746011:0:11035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.746049:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.746060:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 12 pid: 5785 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.746071:0:11035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302336:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951594.746207:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec41d expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.746215:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec41d expref: 18 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.746226:0:11035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302464:0@lo:104: 00000100:00100000:3.0:1783951594.746262:0:11035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951594.746294:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec40f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.746300:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec40f expref: 18 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.746306:0:11035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302592:0@lo:104: 00000100:00100000:3.0:1783951594.746318:0:11035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951594.746331:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec401 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.746336:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec401 expref: 18 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.746341:0:11035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302720:0@lo:104: 00000100:00100000:3.0:1783951594.746351:0:11035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951594.746358:0:11035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.746363:0:11035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 12 pid: 5784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.746377:0:11035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302848:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951594.746392:0:11035:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951594.746532:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624302464 00000100:00100000:0.0:1783951594.746538:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624302464 00000100:00100000:0.0:1783951594.746566:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624302592 00000100:00100000:0.0:1783951594.746568:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624302592 00000100:00100000:0.0:1783951594.746572:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624302720 00000100:00100000:0.0:1783951594.746574:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624302720 00000100:00100000:0.0:1783951594.746583:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951594.746591:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:11035:x1870608624302464:12345-0@lo:104: 00010000:00010000:0.0:1783951594.746603:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746673:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951594.746679:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+5:11035:x1870608624302464:12345-0@lo:104: Request processed in 90us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951594.746687:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951594.746704:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783951594.746709:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:11035:x1870608624302592:12345-0@lo:104: 00010000:00010000:0.0:1783951594.746714:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746737:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783951594.746740:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:11035:x1870608624302592:12345-0@lo:104: Request processed in 32us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951594.746744:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783951594.746751:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951594.746760:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:11035:x1870608624302720:12345-0@lo:104: 00010000:00010000:0.0:1783951594.746765:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746788:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783951594.746791:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:11035:x1870608624302720:12345-0@lo:104: Request processed in 31us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951594.746795:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1783951594.746834:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783951594.746839:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746850:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9c00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951594.746855:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746861:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951594.746866:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951594.746869:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951594.746890:0:8310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746894:0:8310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951594.746912:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746929:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9c00/0x443dabd358eec41d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec424 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746941:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951594.746944:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746949:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951594.746952:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746958:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951594.746965:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951594.746969:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951594.746983:0:8310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.746989:0:8310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951594.746995:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747001:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9800/0x443dabd358eec40f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec416 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747009:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951594.747016:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747020:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951594.747022:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747026:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951594.747029:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951594.747032:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951594.747041:0:8310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747044:0:8310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951594.747054:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747058:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5c00/0x443dabd358eec401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec408 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747067:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951594.747068:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951594.747069:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951594.747073:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951594.747077:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951594.747089:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624302976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951594.747133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951594.747161:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951594.747166:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624303104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951594.747186:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951594.747210:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624303232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951594.747225:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951594.747246:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624302976 00000100:00100000:0.0:1783951594.747249:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624302976 00010000:00010000:0.0:1783951594.747262:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec41d expref: 19 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951594.747274:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624303104 00000100:00100000:0.0:1783951594.747276:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624303104 00010000:00010000:0.0:1783951594.747281:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec40f expref: 20 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951594.747286:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624303232 00000100:00100000:0.0:1783951594.747287:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624303232 00010000:00010000:0.0:1783951594.747291:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec401 expref: 21 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951594.747298:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783951594.747301:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+21:3312:x1870608624302976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951594.747308:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951594.747311:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec41d expref: 21 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747317:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec41d expref: 21 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747328:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951594.747350:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+21:3312:x1870608624302976:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951594.747354:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783951594.747380:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951594.747384:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:3312:x1870608624303104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951594.747388:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951594.747391:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec40f expref: 20 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747396:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec40f expref: 20 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747402:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951594.747413:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:3312:x1870608624303104:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951594.747417:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951594.747423:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951594.747426:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624303232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951594.747430:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951594.747433:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec401 expref: 19 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747438:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec401 expref: 19 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951594.747443:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951594.747456:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624303232:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951594.747459:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951594.747493:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624303232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951594.747507:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624303104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951594.747511:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624302976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951594.747665:0:11035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff9600/0x443dabd358eec424 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec41d expref: 18 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.747676:0:11035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302464:0@lo:104: 00010000:00010000:3.0:1783951594.747685:0:11035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff8400/0x443dabd358eec416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec40f expref: 17 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.747693:0:11035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302592:0@lo:104: 00010000:00010000:3.0:1783951594.747700:0:11035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec401 expref: 16 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.747705:0:11035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302720:0@lo:104: 00000100:00100000:2.0:1783951594.750623:0:11035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302336:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951594.750640:0:11035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11035:1870608624302848:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951594.750684:0:11035:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951594.752535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951594.752618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951594.753054:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602249216 00000100:00100000:0.0:1783951594.753064:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602249216 00010000:00010000:0.0:1783951594.753117:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 13 pid: 5785 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951594.753203:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602249344 00000100:00100000:0.0:1783951594.753207:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602249344 00010000:00010000:0.0:1783951594.753220:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 14 pid: 5784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951594.753253:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:3.0:1783951594.753265:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+14:2359:x1870608602249216:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951594.753280:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951594.753286:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 14 pid: 5785 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753299:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 14 pid: 5785 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753316:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec439 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03858e expref: 14 pid: 5785 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753349:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951594.753407:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602249216:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 144us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951594.753414:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:3.0:1783951594.753430:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:3.0:1783951594.753437:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:2359:x1870608602249344:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951594.753444:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951594.753449:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 12 pid: 5784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753458:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 12 pid: 5784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753468:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce5600/0x443dabd358eec3fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038556 expref: 12 pid: 5784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753478:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753488:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753503:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753510:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753526:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753533:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753540:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951594.753543:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753551:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753566:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951594.753576:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951594.753597:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:2359:x1870608602249344:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 160us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951594.753616:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00010000:00010000:2.0:1783951594.754171:0:11035:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951594.754182:0:11035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951594.754188:0:11035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff8800/0x443dabd358eec455 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951595.768479:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951595.902409:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624303360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951595.902531:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951595.915044:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624303360 00000100:00100000:3.0:1783951595.915063:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624303360 00000100:00100000:3.0:1783951595.915156:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783951595.915169:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624303360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951595.915225:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951595.915357:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624303360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (12826us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951595.915366:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1783951595.915412:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783951595.915484:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d502d7100 x1870608624303360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951595.915514:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624303360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951596.112967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951596.113160:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602249472 00000100:00100000:0.0:1783951596.113175:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602249472 00000100:00100000:0.0:1783951596.113295:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:0.0:1783951596.113309:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:5576:x1870608602249472:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951596.113336:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951596.113363:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385b8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.113402:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.113414:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.113426:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4000, rc 0) 00000100:00100000:0.0:1783951596.113528:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602249472:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 221us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.113537:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:2.0:1783951596.119020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951596.121283:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602249600 00000100:00100000:3.0:1783951596.121305:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602249600 00000100:00100000:3.0:1783951596.121382:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 226 00000100:00100000:3.0:1783951596.121395:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602249600:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951596.122057:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602249600:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 662us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951596.122070:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 226 00000100:00100000:2.0:1783951596.141299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951596.141388:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602249728 00000100:00100000:0.0:1783951596.141402:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602249728 00000100:00100000:0.0:1783951596.141480:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:0.0:1783951596.141494:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602249728:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.141805:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602249728:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 315us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.141838:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:2.0:1783951596.155187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951596.155406:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602249856 00000100:00100000:3.0:1783951596.155419:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602249856 00000100:00100000:3.0:1783951596.155496:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 228 00000100:00100000:3.0:1783951596.155509:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602249856:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951596.155533:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951596.155557:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385bf expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.155595:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.155609:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.155621:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8200, rc 0) 00000100:00100000:3.0:1783951596.155722:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602249856:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 214us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951596.155730:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 228 00000100:00100000:2.0:1783951596.158117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951596.158212:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602249984 00000100:00100000:3.0:1783951596.158226:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602249984 00000100:00100000:3.0:1783951596.158295:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:3.0:1783951596.158307:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602249984:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951596.158708:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602249984:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 401us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951596.158718:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:2.0:1783951596.173066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951596.173217:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602250112 00000100:00100000:0.0:1783951596.173231:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602250112 00000100:00100000:0.0:1783951596.173304:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 230 00000100:00100000:0.0:1783951596.173317:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602250112:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.173625:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602250112:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 309us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.173635:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 230 10000000:01000000:0.0:1783951596.407765:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783951596.407779:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d7a084000 from 7 10000000:01000000:0.0:1783951596.407787:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951596.407966:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.407982:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.407997:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951596.408048:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624303488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.409467:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951596.409531:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d79ed89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951596.410714:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624303488 00000100:00100000:1.0:1783951596.410730:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624303488 00000100:00100000:1.0:1783951596.410853:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783951596.410867:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624303488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951596.410893:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951596.410920:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec46a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951596.410974:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec46a expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951596.410989:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec46a expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951596.411000:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5f200, rc 0) 00000100:00100000:1.0:1783951596.412095:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624303488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1224us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951596.412105:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1783951596.412339:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624303488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951596.412367:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.412380:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951596.412475:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624303616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.412522:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951596.412556:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d79ed89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951596.412574:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624303616 00000100:00100000:0.0:1783951596.412580:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624303616 00000100:00100000:0.0:1783951596.412613:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783951596.412622:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624303616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.413204:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624303616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 581us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.413214:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783951596.413259:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624303616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.413298:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624303744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.413344:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951596.413358:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d79ed89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951596.413376:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624303744 00000100:00100000:0.0:1783951596.413380:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624303744 00000100:00100000:0.0:1783951596.413406:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783951596.413412:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624303744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.413584:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624303744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.413591:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783951596.413627:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624303744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951596.416440:0:11101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783951596.416529:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783951596.416556:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951596.416571:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.416585:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951596.416595:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951596.416599:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d604cd800 from 7 10000000:01000000:3.0:1783951596.416601:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951596.416655:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.416666:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.416679:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951596.416729:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624303872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951596.416867:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951596.416907:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951596.417728:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624303872 00000100:00100000:0.0:1783951596.417740:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624303872 00000100:00100000:0.0:1783951596.420444:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783951596.420467:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624303872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951596.420493:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951596.420518:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec478 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.420559:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec478 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.420574:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec478 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951596.420586:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4800, rc 0) 00000100:00100000:0.0:1783951596.420707:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624303872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.420716:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783951596.420938:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624303872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951596.420963:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.420975:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951596.421080:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951596.421121:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951596.421163:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951596.421290:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624304000 00000100:00100000:0.0:1783951596.421298:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624304000 00000100:00100000:0.0:1783951596.421344:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783951596.421352:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624304000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.421682:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624304000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.421690:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783951596.421995:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951596.422042:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951596.422112:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951596.422145:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951596.422242:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624304128 00000100:00100000:0.0:1783951596.422248:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624304128 00000100:00100000:0.0:1783951596.422278:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783951596.422284:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624304128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.422484:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624304128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.422492:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783951596.422571:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951596.424419:0:11104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783951596.424505:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783951596.424526:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951596.424540:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.424571:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951596.424596:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951596.424600:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d4535a000 from 7 10000000:01000000:3.0:1783951596.424603:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951596.424649:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.424658:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.424670:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951596.424697:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951596.427320:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951596.427387:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7f774000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951596.431227:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624304256 00000100:00100000:2.0:1783951596.431260:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624304256 00000100:00100000:2.0:1783951596.431347:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783951596.431361:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624304256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951596.431385:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951596.431409:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec486 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951596.431445:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec486 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951596.431458:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec486 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951596.431469:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:2.0:1783951596.432170:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624304256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 809us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951596.432179:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783951596.432265:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951596.432293:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951596.432303:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951596.432406:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951596.432451:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951596.432496:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e5900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951596.433723:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624304384 00000100:00100000:0.0:1783951596.433738:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624304384 00000100:00100000:0.0:1783951596.434322:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783951596.434337:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624304384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951596.434792:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624304384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 458us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951596.434802:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1783951596.435342:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951596.435431:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951596.435516:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951596.438940:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624304512 00000100:00100000:3.0:1783951596.438965:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624304512 00000100:00100000:3.0:1783951596.439040:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783951596.439055:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624304512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951596.439707:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624304512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 653us (4188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951596.439721:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783951596.439885:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e5900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951596.439926:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624304512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951596.446161:0:11107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783951596.446509:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783951596.446551:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951596.446562:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951596.446574:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783951596.502751:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5168f61-b22b-4094-aa34-e52db03426e1 00000020:00000080:2.0:1783951596.502767:0:7503:0:(genops.c:906:class_export_put()) final put ffff8e8d757b9000/a5168f61-b22b-4094-aa34-e52db03426e1 00000020:00000080:2.0:1783951596.502858:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d757b9000/a5168f61-b22b-4094-aa34-e52db03426e1 for lustre-OST0001 00000020:00000080:2.0:1783951596.502925:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d5844a000 for lustre-OST0001 00010000:00010000:0.0:1783951596.793295:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951596.926543:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624304896:0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.926615:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951596.926675:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951596.926680:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624305024:0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.926700:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951596.926728:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624304896 00000100:00100000:2.0:1783951596.926733:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624304896 00000100:00100000:2.0:1783951596.926781:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783951596.926793:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624304896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951596.926848:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624304640:0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.926871:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624304896:12345-0@lo:400:kworker.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951596.926880:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783951596.926907:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624305024 00000100:00100000:2.0:1783951596.926911:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624305024 00000100:00100000:0.0:1783951596.926939:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951596.927189:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624304768:0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.927443:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624304640 00000100:00100000:2.0:1783951596.927448:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624304640 00000100:00100000:2.0:1783951596.927489:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783951596.927496:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624305024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951596.930309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783951596.931651:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783951596.931773:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af2680 x1870608624304896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951596.931805:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624304896:0@lo:400:kworker.0 00000100:00100000:3.0:1783951596.931888:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624305024:0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.931907:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624305024:12345-0@lo:400:kworker.0 Request processed in 4395us (5188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951596.931948:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783951596.931993:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624304768 00000100:00100000:2.0:1783951596.932005:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624304768 00000100:00100000:0.0:1783951596.932044:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624305152:0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.932092:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783951596.932102:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624304640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783951596.934235:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951596.934641:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624304640:12345-0@lo:400:kworker.0 Request processed in 2526us (7693us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951596.934660:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783951596.934708:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783951596.934727:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624304768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.934847:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624304768:12345-0@lo:400:kworker.0 Request processed in 129us (4554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951596.934854:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783951596.935260:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624304768:0@lo:400:kworker.0 00000100:00100000:0.0:1783951596.935960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951596.936214:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624305152 00000100:00100000:2.0:1783951596.936230:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624305152 00000100:00100000:0.0:1783951596.936602:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624304640:0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.937338:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783951596.937357:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624305152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951596.937481:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624305152:12345-0@lo:400:kworker.0 Request processed in 131us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951596.937489:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1783951596.937551:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af1f80 x1870608624305152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951596.937565:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624305152:0@lo:400:kworker.0 00000100:00080000:3.0:1783951596.940052:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951597.433784:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624305280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951597.433954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951597.434193:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624305280 00000100:00100000:2.0:1783951597.434205:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624305280 00000100:00100000:2.0:1783951597.434277:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783951597.434290:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624305280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951597.434355:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951597.436660:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624305280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2359us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951597.436681:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1783951597.436797:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81004e00 x1870608624305280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951597.436847:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624305280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783951597.814680:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951597.911873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951597.911918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951597.911944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951597.911984:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602250240 00000100:00100000:3.0:1783951597.911996:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602250240 00000100:00100000:3.0:1783951597.912073:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 240 00000100:00100000:3.0:1783951597.912085:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602250240:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951597.912185:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602250240:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951597.912200:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 240 00000100:00100000:3.0:1783951597.912247:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602250496 00000100:00100000:3.0:1783951597.912251:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602250496 00000100:00100000:3.0:1783951597.912291:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602250368 00000100:00100000:3.0:1783951597.912294:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602250368 00000100:00100000:3.0:1783951597.912315:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:3.0:1783951597.912321:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602250496:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951597.912353:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602250496:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 31us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951597.912359:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:3.0:1783951597.912384:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:3.0:1783951597.912390:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602250368:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951597.912415:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602250368:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951597.912421:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00080000:3.0:1783951597.912532:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1783951598.718801:0:11234:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783951598.838111:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951599.866497:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951600.886891:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951601.014279:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951601.014307:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624305408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951601.014402:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951601.014482:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624305408 00000100:00100000:0.0:1783951601.014491:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624305408 00000100:00100000:0.0:1783951601.014555:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783951601.014566:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624305408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951601.014615:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951601.014665:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624305408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951601.014674:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1783951601.014739:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81006d80 x1870608624305408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951601.014761:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624305408:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783951601.014922:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783951601.910008:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951602.041101:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624305664:0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951602.041211:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624305920:0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041219:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624306176:0@lo:400:kworker.0 00000100:00100000:1.0:1783951602.041242:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951602.041273:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783951602.041280:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624305536:0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041284:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951602.041302:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951602.041305:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951602.041307:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624305792:0@lo:400:kworker.0 00000100:00100000:1.0:1783951602.041324:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624306048:0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041327:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951602.041343:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951602.041364:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624305664 00000100:00100000:2.0:1783951602.041371:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624305664 00000100:00100000:2.0:1783951602.041414:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624305792 00000100:00100000:2.0:1783951602.041417:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624305792 00000100:00100000:2.0:1783951602.041437:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624306048 00000100:00100000:2.0:1783951602.041439:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624306048 00000100:00100000:2.0:1783951602.041454:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783951602.041462:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624305664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951602.041479:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624305920 00000100:00100000:1.0:1783951602.041482:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624305920 00000100:00100000:1.0:1783951602.041507:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624306176 00000100:00100000:1.0:1783951602.041510:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624306176 00000100:00100000:2.0:1783951602.041525:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624305664:12345-0@lo:400:kworker.0 Request processed in 63us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951602.041530:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783951602.041532:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783951602.041536:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624305920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041548:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783951602.041554:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624305792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041579:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624305792:12345-0@lo:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951602.041581:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624305920:12345-0@lo:400:kworker.0 Request processed in 46us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951602.041585:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783951602.041587:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783951602.041597:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783951602.041602:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624306048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951602.041602:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783951602.041607:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624306176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041627:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624306048:12345-0@lo:400:kworker.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951602.041627:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624306176:12345-0@lo:400:kworker.0 Request processed in 19us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951602.041633:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783951602.041633:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783951602.041651:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624305536 00000100:00100000:1.0:1783951602.041655:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624305536 00000100:00080000:2.0:1783951602.041661:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951602.041665:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951602.041678:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783951602.041684:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624305536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041693:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624305792:0@lo:400:kworker.0 00000100:00100000:2.0:1783951602.041703:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624305664:0@lo:400:kworker.0 00000100:00100000:1.0:1783951602.041718:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624305536:12345-0@lo:400:kworker.0 Request processed in 34us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951602.041725:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00080000:2.0:1783951602.041732:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a08bb80 x1870608624306176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951602.041742:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624306176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951602.049004:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624305536:0@lo:400:kworker.0 00000100:00100000:0.0:1783951602.049029:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624306048:0@lo:400:kworker.0 00010000:00080000:0.0:1783951602.049045:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af2680 x1870608624305920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951602.049055:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624305920:0@lo:400:kworker.0 00000100:00100000:0.0:1783951602.552031:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951602.552054:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624306304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951602.552131:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951602.552196:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624306304 00000100:00100000:0.0:1783951602.552203:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624306304 00000100:00100000:0.0:1783951602.552252:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783951602.552261:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624306304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951602.552299:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951602.552343:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624306304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951602.552350:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1783951602.552389:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81006d80 x1870608624306304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951602.552409:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624306304:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1783951602.632588:0:11334:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:06:41 (1783951601) === 00000100:00100000:2.0:1783951602.849748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951602.849902:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951602.850014:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602250752 00000100:00100000:1.0:1783951602.850025:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602250752 00000100:00100000:1.0:1783951602.850091:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783951602.850104:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:9662:x1870608602250752:12345-192.168.201.6@tcp:700:mkdir.0 00000100:00100000:1.0:1783951602.850203:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:9662:x1870608602250752:12345-192.168.201.6@tcp:700:mkdir.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951602.850211:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00080000:0.0:1783951602.852281:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951602.854293:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602250624 00000100:00100000:3.0:1783951602.854309:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602250624 00000100:00100000:3.0:1783951602.854379:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1783951602.854390:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602250624:12345-192.168.201.6@tcp:41:mkdir.0 00000004:00000024:3.0:1783951602.854438:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783951602.854622:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602250624:12345-192.168.201.6@tcp:41:mkdir.0 Request processed in 142us (4789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951602.854646:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1783951602.854953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951602.857323:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602251008 00000100:00100000:2.0:1783951602.857339:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602251008 00000100:00100000:2.0:1783951602.857421:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:2.0:1783951602.857430:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:9662:x1870608602251008:12345-192.168.201.6@tcp:36:mkdir.0 00010000:00010000:2.0:1783951602.857493:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951602.857572:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec375 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038541 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.857591:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:2.0:1783951602.857602:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951602.858021:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.858035:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.858046:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.858059:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.858066:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.858073:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951602.859416:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783951602.859433:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.859443:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.859456:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.859463:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951602.859468:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.859477:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.859492:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d44e70100) 00010000:00010000:2.0:1783951602.859495:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951602.859500:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.859505:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec494 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951602.859524:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d63566ef reply state 0000000021781471 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951602.859534:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951602.859652:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:9662:x1870608602251008:12345-192.168.201.6@tcp:36:mkdir.0 Request processed in 2220us (4697us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783951602.859662:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:1.0:1783951602.861510:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.861525:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.861533:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.861554:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951602.861559:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.861566:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.861584:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8d44e70400) 00010000:00010000:1.0:1783951602.861588:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951602.861592:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.861599:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec49b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951602.886552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951602.886856:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602251136 00000100:00100000:1.0:1783951602.886868:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602251136 00000100:00100000:1.0:1783951602.886943:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1783951602.886954:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:9663:x1870608602251136:12345-192.168.201.6@tcp:101:chmod.0 00010000:00010000:1.0:1783951602.886991:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951602.887018:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec4a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385c6 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.887242:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.887258:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.887271:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951602.887371:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783951602.887376:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951602.887415:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.887442:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec4a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385c6 expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.887461:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385c6 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.887469:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d71d6df00) 00010000:00010000:1.0:1783951602.887472:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951602.887475:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5f800, rc 0) 00000100:00100000:1.0:1783951602.887541:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:9663:x1870608602251136:12345-192.168.201.6@tcp:101:chmod.0 Request processed in 588us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951602.887548:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1783951602.892131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951602.895335:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602251392 00000100:00100000:2.0:1783951602.895358:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602251392 00000100:00100000:2.0:1783951602.895436:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1783951602.895446:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:9663:x1870608602251392:12345-192.168.201.6@tcp:36:chmod.0 00010000:00010000:2.0:1783951602.895522:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951602.895548:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385c6 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.895569:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d71d6df00) 00010000:00010000:2.0:1783951602.895578:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951602.895603:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.895615:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.895624:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951602.896420:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061193639 reply state 00000000c8875c2d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951602.896434:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783951602.896451:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783951602.896608:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:9663:x1870608602251392:12345-192.168.201.6@tcp:36:chmod.0 Request processed in 1160us (4484us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783951602.896616:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00010000:00010000:3.0:1783951602.903731:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.903753:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.903761:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.903768:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951602.903774:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.903782:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.903802:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d44e70e00) 00010000:00010000:3.0:1783951602.903805:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783951602.903840:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.903849:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec4b0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951602.934354:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951602.945484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951602.945867:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602251520 00000100:00100000:1.0:1783951602.945879:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602251520 00000100:00100000:1.0:1783951602.945949:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1783951602.945973:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:9664:x1870608602251520:12345-192.168.201.6@tcp:101:chown.0 00010000:00010000:1.0:1783951602.946002:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951602.946028:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec4b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385cd expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.946108:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.946155:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951602.946168:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951602.949001:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783951602.949014:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951602.949098:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.949792:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec4b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385cd expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.949862:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385cd expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951602.949872:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:2.0:1783951602.949876:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951602.949879:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5f800, rc 0) 00000100:00100000:2.0:1783951602.950008:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:9664:x1870608602251520:12345-192.168.201.6@tcp:101:chown.0 Request processed in 4048us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951602.950017:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:0.0:1783951602.968373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951602.968501:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602251648 00000100:00100000:3.0:1783951602.968511:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602251648 00000100:00100000:3.0:1783951602.968575:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1783951602.968586:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:9664:x1870608602251648:12345-192.168.201.6@tcp:101:chown.0 00010000:00010000:3.0:1783951602.968624:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951602.968658:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385d4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968743:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968758:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968770:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968786:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968794:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968802:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968973:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968982:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.968989:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951602.969033:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783951602.969043:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951602.969078:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969091:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969097:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969105:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969111:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951602.969116:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969124:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969137:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:3.0:1783951602.969140:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951602.969146:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969151:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec4cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969164:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969170:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969186:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969191:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951602.969194:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969201:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969210:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951602.969213:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951602.969216:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969223:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec4d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969255:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385d4 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969271:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385d4 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.969278:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:3.0:1783951602.969280:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951602.969283:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:3.0:1783951602.969345:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:9664:x1870608602251648:12345-192.168.201.6@tcp:101:chown.0 Request processed in 761us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951602.969362:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1783951602.976211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951602.976374:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602251904 00000100:00100000:3.0:1783951602.976385:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602251904 00000100:00100000:3.0:1783951602.976456:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1783951602.976466:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:9664:x1870608602251904:12345-192.168.201.6@tcp:36:chown.0 00010000:00010000:3.0:1783951602.976522:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951602.976550:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385d4 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.976570:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:3.0:1783951602.976580:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951602.976610:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.976623:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951602.976633:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951603.025074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951603.025122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951603.025211:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602252032 00000100:00100000:2.0:1783951603.025221:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602252032 00000100:00100000:2.0:1783951603.025289:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 242 00000100:00100000:2.0:1783951603.025299:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602252032:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951603.025379:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602252032:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951603.025387:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 242 00000100:00100000:1.0:1783951603.026633:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602252160 00000100:00100000:1.0:1783951603.026642:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602252160 00000100:00100000:1.0:1783951603.026928:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:1.0:1783951603.026939:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602252160:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951603.027024:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602252160:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 88us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951603.027032:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00000004:00010000:3.0:1783951603.028317:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c37836b4 reply state 00000000defaf083 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951603.028335:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783951603.028515:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783951603.028609:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:9664:x1870608602251904:12345-192.168.201.6@tcp:36:chown.0 Request processed in 52139us (52403us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783951603.028629:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000001:00080000:0.0:1783951603.029297:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1783951603.029334:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1783951603.030613:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.030629:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.030638:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.030644:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951603.030860:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.030872:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.030892:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:3.0:1783951603.030895:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783951603.030900:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.030907:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783951603.031557:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951603.049123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951603.050248:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602252288 00000100:00100000:2.0:1783951603.050261:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602252288 00000100:00100000:2.0:1783951603.050327:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:2.0:1783951603.050338:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:9665:x1870608602252288:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:2.0:1783951603.050369:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951603.050394:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec4e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385db expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951603.051926:0:8068:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1439us 00010000:00010000:3.0:1783951603.063356:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.063379:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.063391:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.063416:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.063424:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.063430:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064062:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec4fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064074:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064083:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951603.064165:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783951603.064169:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951603.064415:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064430:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064436:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064442:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064458:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951603.064463:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064471:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064482:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:3.0:1783951603.064485:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951603.064490:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064496:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec4ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064509:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064515:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064521:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064526:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951603.064528:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064534:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064551:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8d821cf000) 00010000:00010000:3.0:1783951603.064554:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951603.064556:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064562:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec4f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064600:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec4e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385db expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064615:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385db expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.064622:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:3.0:1783951603.064625:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783951603.064627:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8600, rc 0) 00000100:00100000:3.0:1783951603.064843:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:9665:x1870608602252288:12345-192.168.201.6@tcp:101:touch.500 Request processed in 14505us (15731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951603.064853:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783951603.067856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951603.067989:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602252544 00000100:00100000:3.0:1783951603.068001:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602252544 00000100:00100000:3.0:1783951603.068069:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:3.0:1783951603.068080:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:9665:x1870608602252544:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:3.0:1783951603.068105:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951603.068133:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec504 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385e2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.068522:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.068538:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.068550:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.068566:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.068573:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.068579:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951603.069502:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1783951603.071339:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec519 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071362:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071374:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071439:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071461:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071538:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071545:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951603.071551:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071558:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071571:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:3.0:1783951603.071574:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951603.071579:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071585:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec50b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951603.071597:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0059c75 reply state 0000000033bace53 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951603.071606:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783951603.071896:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec504 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385e2 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071917:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385e2 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.071937:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:3.0:1783951603.071940:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951603.071943:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:3.0:1783951603.072096:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:9665:x1870608602252544:12345-192.168.201.6@tcp:101:touch.500 Request processed in 4015us (4287us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783951603.072106:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1783951603.080637:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:0.0:1783951603.081142:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.081175:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.081184:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.081190:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951603.081196:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.081204:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.081222:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff8e8d821cf400) 00010000:00010000:0.0:1783951603.081235:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951603.081240:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.081245:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec512 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951603.082395:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602252800 00000100:00100000:1.0:1783951603.082411:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602252800 00000100:00100000:1.0:1783951603.082596:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:1.0:1783951603.082607:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:9665:x1870608602252800:12345-192.168.201.6@tcp:36:touch.500 00010000:00010000:1.0:1783951603.082681:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951603.082705:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec519 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385e2 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.082720:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:1.0:1783951603.082739:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951603.082791:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.082805:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.082861:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951603.083051:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c046448e reply state 00000000cae793fb transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951603.083062:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951603.083195:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:9665:x1870608602252800:12345-192.168.201.6@tcp:36:touch.500 Request processed in 588us (2567us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783951603.083204:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1783951603.091087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951603.091168:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602252928 00000100:00100000:1.0:1783951603.091180:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602252928 00000100:00100000:1.0:1783951603.091254:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1783951603.091268:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:9665:x1870608602252928:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:1.0:1783951603.091295:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951603.091320:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec52e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385e9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.091391:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec52e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385e9 expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.091405:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec52e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385e9 expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.091427:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8d71d6dd00) 00010000:00010000:1.0:1783951603.091431:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951603.091435:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5e000, rc 0) 00000100:00100000:1.0:1783951603.091520:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:9665:x1870608602252928:12345-192.168.201.6@tcp:101:touch.500 Request processed in 256us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951603.091528:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00010000:00010000:3.0:1783951603.093301:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.093318:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.093325:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.093331:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951603.093336:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.093344:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.093361:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8d71d6dd00) 00010000:00010000:3.0:1783951603.093364:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951603.093368:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.093374:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec527 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951603.099036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951603.099198:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602253056 00000100:00100000:1.0:1783951603.099208:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602253056 00000100:00100000:1.0:1783951603.099360:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1783951603.099369:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1870608602253056:12345-192.168.201.6@tcp:8:touch.500 00010000:00080000:1.0:1783951603.099405:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:1.0:1783951603.099443:0:6590:0:(genops.c:1406:class_connect()) connect: client 65c652b5-a392-4c36-a8f6-f2bd53c90279, cookie 0x443dabd358eec535 00002000:00100000:1.0:1783951603.099457:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 65c652b5-a392-4c36-a8f6-f2bd53c90279/ffff8e8d75773800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783951603.099498:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951603.099791:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783951603.099857:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8e8d75776800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951603.099948:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2357:x1870608602253056:12345-192.168.201.6@tcp:8:touch.500 Request processed in 577us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951603.099966:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1783951603.103543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951603.103644:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602253184 00000100:00100000:0.0:1783951603.103656:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602253184 00000100:00100000:0.0:1783951603.103737:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1783951603.103749:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:0:x1870608602253184:12345-192.168.201.6@tcp:2:touch.500 00000100:00080000:2.0:1783951603.103914:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1783951603.165180:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1783951603.165203:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000100:00100000:2.0:1783951603.165550:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:0:x1870608602253184:12345-192.168.201.6@tcp:2:touch.500 Request processed in 61796us (62010us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783951603.165562:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1783951603.168464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951603.169117:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602253440 00000100:00100000:2.0:1783951603.169131:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602253440 00000100:00100000:0.0:1783951603.169410:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:0.0:1783951603.169436:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:9665:x1870608602253440:12345-192.168.201.6@tcp:35:touch.500 00000100:00100000:0.0:1783951603.169904:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:9665:x1870608602253440:12345-192.168.201.6@tcp:35:touch.500 Request processed in 469us (1454us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783951603.169913:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:0.0:1783951603.189195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951603.189439:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602253568 00000100:00100000:3.0:1783951603.189452:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602253568 00000100:00100000:3.0:1783951603.189523:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1783951603.189535:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:9666:x1870608602253568:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:3.0:1783951603.189565:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951603.189590:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec53c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385f0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.189693:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.189720:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.189738:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951603.189883:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783951603.189887:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951603.189940:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.189981:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec53c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385f0 expref: 13 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.190000:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385f0 expref: 12 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.190027:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:3.0:1783951603.190031:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951603.190035:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8000, rc 0) 00000100:00100000:3.0:1783951603.190348:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+12:9666:x1870608602253568:12345-192.168.201.6@tcp:101:rm.0 Request processed in 814us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951603.190359:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:2.0:1783951603.196881:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951603.196933:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602253824 00000100:00100000:1.0:1783951603.196944:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602253824 00000100:00100000:1.0:1783951603.197026:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1783951603.197038:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+12:9666:x1870608602253824:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:1.0:1783951603.197064:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951603.197087:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec54a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385f7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951603.197246:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783951603.197441:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec54a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385f7 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.197464:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:1.0:1783951603.197467:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951603.197473:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec54a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385f7 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.197494:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5fc00, rc 0) 00000100:00100000:1.0:1783951603.197568:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:9666:x1870608602253824:12345-192.168.201.6@tcp:101:rm.0 Request processed in 532us (854us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1783951603.197576:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:2.0:1783951603.201930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951603.202767:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602253952 00000100:00100000:1.0:1783951603.202781:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602253952 00000100:00100000:1.0:1783951603.202892:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1783951603.202904:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:9666:x1870608602253952:12345-192.168.201.6@tcp:37:rm.0 00000100:00100000:1.0:1783951603.216460:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:9666:x1870608602253952:12345-192.168.201.6@tcp:37:rm.0 Request processed in 13546us (14529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951603.216476:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:2.0:1783951603.225664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951603.225774:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602254208 00000100:00100000:0.0:1783951603.225785:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602254208 00000100:00100000:0.0:1783951603.225885:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1783951603.225898:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d518ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:9666:x1870608602254208:12345-192.168.201.6@tcp:35:rm.0 00000100:00100000:0.0:1783951603.226210:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d518ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:9666:x1870608602254208:12345-192.168.201.6@tcp:35:rm.0 Request processed in 315us (566us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783951603.226219:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1783951603.228850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951603.229792:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602254464 00000100:00100000:3.0:1783951603.229804:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602254464 00000100:00100000:3.0:1783951603.229910:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:3.0:1783951603.229920:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:9666:x1870608602254464:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:3.0:1783951603.229945:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951603.229979:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0385fe expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.230135:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec55f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.230153:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec55f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.230165:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec55f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951603.230177:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783951603.230311:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385fe expref: 17 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.230333:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec55f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385fe expref: 16 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.230356:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:3.0:1783951603.230359:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951603.230362:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8800, rc 0) 00000100:00100000:3.0:1783951603.230427:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:9666:x1870608602254464:12345-192.168.201.6@tcp:101:rm.0 Request processed in 508us (1589us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783951603.230434:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1783951603.238098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951603.240090:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602254592 00000100:00100000:1.0:1783951603.240112:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602254592 00000100:00100000:1.0:1783951603.240305:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1783951603.240318:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:9666:x1870608602254592:12345-192.168.201.6@tcp:41:rm.0 00000004:00000024:1.0:1783951603.240411:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1783951603.240660:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:9666:x1870608602254592:12345-192.168.201.6@tcp:41:rm.0 Request processed in 344us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951603.240671:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:2.0:1783951603.244909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951603.245327:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602254720 00000100:00100000:1.0:1783951603.245337:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602254720 00000100:00100000:1.0:1783951603.245393:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:1.0:1783951603.245405:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:9666:x1870608602254720:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:1.0:1783951603.245426:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951603.245446:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec56d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038605 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.245505:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.245519:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.245531:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.245544:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.245551:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.245557:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246396:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031800/0x443dabd358eec582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246407:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031800/0x443dabd358eec582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246428:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031800/0x443dabd358eec582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951603.246462:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783951603.246466:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951603.246481:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031800/0x443dabd358eec582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246492:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031800/0x443dabd358eec582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246501:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246508:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246514:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246520:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951603.246524:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246532:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246543:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:1.0:1783951603.246546:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951603.246550:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246565:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246578:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246584:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246590:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246595:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951603.246597:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246603:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246610:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff8e8d71d6dc00) 00010000:00010000:1.0:1783951603.246612:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951603.246615:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.246620:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec57b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.247187:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec56d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038605 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.247209:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031800/0x443dabd358eec582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038605 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.247320:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8d71d6dd00) 00010000:00010000:1.0:1783951603.247323:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951603.247326:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d40031800, rc 0) 00000100:00100000:1.0:1783951603.247392:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:9666:x1870608602254720:12345-192.168.201.6@tcp:101:rm.0 Request processed in 1989us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951603.247400:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1783951603.253688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951603.253801:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602254976 00000100:00100000:1.0:1783951603.253837:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602254976 00000100:00100000:1.0:1783951603.253911:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1783951603.253922:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:9666:x1870608602254976:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:1.0:1783951603.254006:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783951603.254035:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031800/0x443dabd358eec582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038605 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254061:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec52e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385e9 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254072:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8d71d6dd00) 00010000:00010000:1.0:1783951603.254089:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385f0 expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254097:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:1.0:1783951603.254100:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951603.254120:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254153:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254164:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254180:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254188:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254194:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254329:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254338:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.254344:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951603.255191:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1783951603.255204:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320160392819ns, next at 321160390281ns, rc = 0 00010000:00010000:1.0:1783951603.255274:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255286:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255305:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255314:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255319:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255325:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255341:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951603.255363:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255370:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255376:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255382:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40031a00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951603.255387:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255394:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255404:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951603.255407:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783951603.255418:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255424:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031a00/0x443dabd358eec597 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255451:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255458:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255464:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255468:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40030e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951603.255471:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255477:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255483:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:1.0:1783951603.255485:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951603.255487:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951603.255491:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030e00/0x443dabd358eec589 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951603.255498:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ce94621 reply state 00000000bc738692 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951603.255512:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951603.255611:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:9666:x1870608602254976:12345-192.168.201.6@tcp:36:rm.0 Request processed in 1689us (1933us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783951603.255618:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00010000:00010000:2.0:1783951603.255803:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951603.255828:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951603.255835:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40030c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951603.255839:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951603.255844:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951603.255854:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:2.0:1783951603.255857:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783951603.255867:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951603.255873:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eec59e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951603.255888:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951603.255890:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951603.255891:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951603.260370:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.260390:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.260399:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.260406:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40031000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951603.260411:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.260420:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.260436:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff8e8d71d6dc00) 00010000:00010000:0.0:1783951603.260455:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951603.260461:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.260467:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40031000/0x443dabd358eec590 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951603.264412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951603.264490:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602255232 00000100:00100000:1.0:1783951603.264499:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602255232 00000100:00100000:1.0:1783951603.264562:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1783951603.264573:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:9666:x1870608602255232:12345-192.168.201.6@tcp:35:rm.0 00000100:00100000:1.0:1783951603.265805:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:9666:x1870608602255232:12345-192.168.201.6@tcp:35:rm.0 Request processed in 1227us (1397us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783951603.265840:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1783951603.272450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951603.272543:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602255488 00000100:00100000:3.0:1783951603.272554:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602255488 00000100:00100000:3.0:1783951603.272629:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:3.0:1783951603.272639:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:9666:x1870608602255488:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:3.0:1783951603.272704:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783951603.272743:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec55f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385fe expref: 16 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.272766:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec4fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385db expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.272777:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfa00) 00010000:00010000:3.0:1783951603.272795:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec4be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385cd expref: 14 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.272805:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:3.0:1783951603.272837:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951603.272880:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.272911:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.272921:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.272935:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.272943:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.272949:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273274:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273284:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273291:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951603.273898:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783951603.273913:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273921:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273928:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273940:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951603.273945:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273963:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273975:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8d821cfc00) 00010000:00010000:3.0:1783951603.273978:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783951603.273982:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.273988:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9e00/0x443dabd358eec5b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.274006:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.274011:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.274017:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.274022:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951603.274025:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.274030:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.274047:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cf800) 00010000:00010000:3.0:1783951603.274049:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951603.274053:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951603.274059:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9400/0x443dabd358eec5a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951603.274071:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ab8c509 reply state 000000006cdafcd9 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951603.274081:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951603.274174:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:9666:x1870608602255488:12345-192.168.201.6@tcp:36:rm.0 Request processed in 1534us (2372us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783951603.274182:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00010000:00010000:0.0:1783951603.276578:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.276596:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.276604:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.276611:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951603.276615:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.276622:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.276639:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8d821cf100) 00010000:00010000:0.0:1783951603.276642:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951603.276646:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.276653:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec5ac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951603.958704:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951604.986417:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951606.005988:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783951606.134968:0:6777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323040153379ns, next at 324040149011ns, rc = 0 00000100:00100000:0.0:1783951606.135023:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624306432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951606.135128:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951606.135228:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624306432 00000100:00100000:0.0:1783951606.135237:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624306432 00000100:00100000:0.0:1783951606.135293:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783951606.135302:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624306432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951606.135348:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951606.135393:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624306432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951606.135400:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1783951606.135447:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81007800 x1870608624306432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951606.135470:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624306432:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783951606.135803:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951607.030842:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951607.159386:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624306816:0@lo:400:kworker.0 00000100:00100000:3.0:1783951607.159473:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951607.159536:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783951607.159543:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624306688:0@lo:400:kworker.0 00000100:00100000:3.0:1783951607.159569:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951607.159589:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624307200:0@lo:400:kworker.0 00000100:00100000:3.0:1783951607.159636:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951607.159679:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624306816 00000100:00100000:3.0:1783951607.159773:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624306816 00000100:00100000:2.0:1783951607.159787:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624306560:0@lo:400:kworker.0 00000100:00100000:2.0:1783951607.159840:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951607.159846:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624306688 00000100:00100000:3.0:1783951607.159850:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624306688 00000100:00100000:2.0:1783951607.159861:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624307072:0@lo:400:kworker.0 00000100:00100000:3.0:1783951607.159870:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783951607.159880:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951607.159885:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624306816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951607.159902:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951607.159906:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624306944:0@lo:400:kworker.0 00000100:00100000:2.0:1783951607.159926:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951607.159942:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624306816:12345-0@lo:400:kworker.0 Request processed in 58us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951607.159949:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783951607.159949:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624306560 00000100:00100000:2.0:1783951607.159952:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624306560 00000100:00100000:3.0:1783951607.159965:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624307072 00000100:00100000:3.0:1783951607.159968:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624307072 00000100:00100000:2.0:1783951607.159975:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783951607.159981:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624306560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951607.159982:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783951607.159986:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624306688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951607.160008:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624306688:12345-0@lo:400:kworker.0 Request processed in 21us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951607.160009:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624306560:12345-0@lo:400:kworker.0 Request processed in 29us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951607.160014:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783951607.160015:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783951607.160024:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783951607.160030:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624307072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951607.160038:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624307200 00000100:00100000:2.0:1783951607.160041:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624307200 00000100:00100000:2.0:1783951607.160066:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624306944 00000100:00100000:2.0:1783951607.160075:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624306944 00000100:00100000:2.0:1783951607.160095:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951607.160101:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624307200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951607.160144:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624307200:12345-0@lo:400:kworker.0 Request processed in 43us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951607.160150:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951607.160160:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951607.160166:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624306944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951607.160191:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624306944:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951607.160197:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783951607.160244:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81444000 x1870608624306944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951607.160270:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624306944:0@lo:400:kworker.0 00000100:00100000:2.0:1783951607.160281:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624306560:0@lo:400:kworker.0 00000100:00100000:3.0:1783951607.161255:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624307072:12345-0@lo:400:kworker.0 Request processed in 1220us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951607.161264:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1783951607.161295:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951607.161301:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951607.161328:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624306688:0@lo:400:kworker.0 00010000:00080000:3.0:1783951607.161341:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81446680 x1870608624307200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951607.161350:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624307200:0@lo:400:kworker.0 00000100:00100000:3.0:1783951607.161360:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624306816:0@lo:400:kworker.0 00000100:00100000:2.0:1783951607.162203:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624307072:0@lo:400:kworker.0 00000100:00100000:1.0:1783951607.670130:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624307328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951607.670223:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951607.670354:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624307328 00000100:00100000:0.0:1783951607.670366:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624307328 00000100:00100000:0.0:1783951607.670429:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783951607.670439:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624307328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951607.670485:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951607.674555:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624307328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4100us (4315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951607.674576:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1783951607.681716:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81007800 x1870608624307328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951607.681746:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624307328:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1783951607.683538:0:11483:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1783951608.054165:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951608.153466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951608.153823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951608.153910:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602255616 00000100:00100000:3.0:1783951608.153927:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602255616 00000100:00100000:3.0:1783951608.153994:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 244 00000100:00100000:3.0:1783951608.154006:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2358:x1870608602255616:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951608.154091:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2358:x1870608602255616:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 88us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951608.154100:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 244 00000100:00100000:1.0:1783951608.155328:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602255872 00000100:00100000:2.0:1783951608.155337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951608.155339:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602255872 00000100:00100000:2.0:1783951608.155398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951608.155411:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1783951608.155423:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602255872:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951608.155432:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602255744 00000100:00100000:2.0:1783951608.155438:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602255744 00000100:00100000:2.0:1783951608.155475:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602256000 00000100:00100000:2.0:1783951608.155479:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602256000 00000100:00100000:1.0:1783951608.155481:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602255872:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 61us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951608.155491:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:2.0:1783951608.155507:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:2.0:1783951608.155516:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:2358:x1870608602255744:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951608.155559:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:2358:x1870608602255744:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 44us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951608.155566:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:2.0:1783951608.155580:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:2.0:1783951608.155586:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602256000:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951608.155608:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602256000:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951608.155614:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00080000:3.0:1783951608.155672:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951608.155678:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1783951608.301967:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1783951608.302021:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:0.0:1783951608.302033:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1783951608.302040:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1783951608.302052:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1783951608.302451:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951608.302481:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624307456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783951608.302559:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951608.302887:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624307456 00000100:00100000:2.0:1783951608.302895:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624307456 00000100:00080000:0.0:1783951608.302941:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951608.302967:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951608.302976:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624307456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783951608.303012:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1783951608.303050:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a54f0f3, atime: 0x6a54f0f3, ctime: 0x6a54f0f3, blocks: 0x1 00010000:00010000:2.0:1783951608.303059:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951608.303079:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1783951608.303083:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951608.303092:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951608.303111:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951608.303121:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951608.303249:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951608.303275:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951608.303644:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951608.303651:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.303660:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951608.303664:0:8311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.303673:0:8311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.303694:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.303701:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a79566c/0x443dabd358eec5ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.303722:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951608.303724:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951608.303725:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951608.304083:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624307456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1107us (1523us total) trans 4294967300 rc 0/0 00000004:00080000:1.0:1783951608.304163:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d7593c000/2, rc 0, transno 4294967300 00000100:00100000:1.0:1783951608.304171:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624307456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783951608.310017:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:00000080:0.0:1783951608.961259:0:11533:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd946c630 20000000:00000080:0.0:1783951608.961279:0:11533:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8d65ac0000 uarg=0000000000000000 20000000:01000000:0.0:1783951608.962274:0:11533:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783951608.962282:0:11533:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783951608.962288:0:11533:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1783951608.963457:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1783951608.963681:0:11533:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1783951608.969345:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1783951608.969408:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1783951608.969456:0:11533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1783951608.969476:0:11533:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783951608.969498:0:11533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.969521:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.969530:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.969538:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec46a expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.969545:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec478 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.969621:0:11533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec486 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.969637:0:11533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.969681:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec486 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.969697:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec486 expref: 18 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951608.969712:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81007800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624307584:0@lo:104: 00000100:00100000:0.0:1783951608.969778:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951608.970030:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624307584 00000100:00100000:2.0:1783951608.970039:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624307584 00000100:00100000:2.0:1783951608.970104:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951608.970115:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:11533:x1870608624307584:12345-0@lo:104: 00010000:00010000:2.0:1783951608.970130:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.970227:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec478 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.970236:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec478 expref: 18 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951608.970245:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624307712:0@lo:104: 00010000:00010000:2.0:1783951608.972621:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951608.972636:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:11533:x1870608624307584:12345-0@lo:104: Request processed in 2519us (2853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951608.972647:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1783951608.972726:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951608.972735:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.972759:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9600 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:1.0:1783951608.972764:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.972774:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951608.972782:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951608.972788:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951608.972866:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.972873:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951608.972894:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.972901:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9600/0x443dabd358eec486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec48d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.972915:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951608.972917:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951608.972919:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951608.972932:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624307840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951608.972972:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951608.973038:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624307840 00000100:00100000:1.0:1783951608.973044:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624307840 00010000:00010000:1.0:1783951608.973069:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec486 expref: 19 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951608.973102:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951608.973110:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624307840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951608.973122:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951608.973127:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec486 expref: 19 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.973138:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec486 expref: 19 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.973156:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951608.973187:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624307840:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951608.973193:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951608.973230:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624307840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951608.974143:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951608.974236:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eec46a expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.974249:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eec46a expref: 18 pid: 5785 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951608.974261:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624307968:0@lo:104: 00000100:00100000:1.0:1783951608.974292:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951608.974472:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.974484:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 12 pid: 5786 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951608.974507:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624308096:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951608.974584:0:11533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.974595:0:11533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 12 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951608.974605:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624308224:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951608.974626:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d48198540 going to sleep for 11 seconds 00010000:00010000:1.0:1783951608.974644:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165e600/0x443dabd358eec48d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec486 expref: 18 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951608.974657:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81007800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624307584:0@lo:104: 00000100:00100000:3.0:1783951608.977880:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783951608.977910:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624307712 00000100:00100000:3.0:1783951608.977919:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624307712 00000100:00100000:3.0:1783951608.977966:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624307968 00000100:00100000:3.0:1783951608.977969:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624307968 00000100:00100000:3.0:1783951608.977987:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951608.977996:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:11533:x1870608624307712:12345-0@lo:104: 00010000:00010000:3.0:1783951608.978015:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951608.978110:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783951608.978116:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+4:11533:x1870608624307712:12345-0@lo:104: Request processed in 122us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951608.978123:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951608.978140:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783951608.978146:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:11533:x1870608624307968:12345-0@lo:104: 00010000:00010000:3.0:1783951608.978154:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951608.978186:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783951608.978201:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+3:11533:x1870608624307968:12345-0@lo:104: Request processed in 55us (3909us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951608.978207:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783951608.978421:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624307712:0@lo:104: 00000100:00100000:1.0:1783951608.978433:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624307968:0@lo:104: 00000100:00100000:0.0:1783951608.978927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951608.978955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:0.0:1783951608.978974:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951608.978983:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.978993:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951608.978997:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979007:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951608.979025:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951608.979031:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951608.979080:0:8310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979086:0:8310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951608.979109:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979117:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8400/0x443dabd358eec478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec47f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979130:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951608.979134:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979140:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5600 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951608.979143:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979149:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951608.979156:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951608.979161:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951608.979197:0:8310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979202:0:8310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951608.979209:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979215:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eec46a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eec471 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979230:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951608.979231:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951608.979233:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951608.979249:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602256128 00000100:00100000:0.0:1783951608.979254:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602256128 00010000:00010000:0.0:1783951608.979284:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 13 pid: 5786 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951608.979307:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602256256 00000100:00100000:0.0:1783951608.979310:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602256256 00010000:00010000:0.0:1783951608.979335:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 14 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951608.979355:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1783951608.979532:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+14:2358:x1870608602256128:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951608.979544:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951608.979561:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 14 pid: 5786 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979572:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 14 pid: 5786 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979600:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951608.979648:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+14:2358:x1870608602256128:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 119us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951608.979655:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1783951608.979672:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:0.0:1783951608.979679:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602256256:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951608.979687:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951608.979691:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 13 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979699:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 13 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.979708:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951608.979724:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602256256:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 46us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951608.979730:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:0.0:1783951608.979788:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624308352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951608.979853:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951608.979900:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951608.979906:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624308480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951608.979926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951608.979947:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624308352 00000100:00100000:0.0:1783951608.979951:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624308352 00010000:00010000:0.0:1783951608.979965:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec478 expref: 18 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951608.979990:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624308480 00000100:00100000:0.0:1783951608.979993:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624308480 00010000:00010000:0.0:1783951608.980004:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec46a expref: 19 pid: 5785 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951608.980016:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783951608.980021:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624308352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951608.980029:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951608.980033:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec478 expref: 19 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980043:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec478 expref: 19 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980054:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec47f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec478 expref: 19 pid: 5784 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980064:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951608.980092:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3312:x1870608624308352:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951608.980098:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783951608.980111:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783951608.980117:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:3312:x1870608624308480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951608.980123:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951608.980127:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eec46a expref: 17 pid: 5785 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980134:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eec46a expref: 17 pid: 5785 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980150:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5f200/0x443dabd358eec471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eec46a expref: 17 pid: 5785 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980162:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980171:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980184:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980192:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980199:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980205:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980210:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4600 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951608.980214:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980222:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980230:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951608.980249:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951608.980270:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:3312:x1870608624308480:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951608.980276:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1783951608.980897:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff8200/0x443dabd358eec463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385bf expref: 12 pid: 5786 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951608.980910:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624308096:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951608.980922:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce4000/0x443dabd358eec45c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0385b8 expref: 11 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951608.980931:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11533:1870608624308224:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951608.980962:0:11533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.980984:0:11533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.980990:0:11533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951608.980997:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce4600/0x443dabd358eec5c1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951608.982880:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951608.983937:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1783951608.984572:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624308480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951608.984587:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624308352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951609.081254:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951610.102458:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783951610.169166:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783951610.169178:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d7a084000 from 7 10000000:01000000:2.0:1783951610.169184:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951610.169241:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951610.169269:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951610.169280:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951610.169320:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624308608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951610.169409:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951610.169516:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951610.169988:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624308608 00000100:00100000:0.0:1783951610.169996:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624308608 00000100:00100000:0.0:1783951610.170082:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783951610.170093:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:5788:x1870608624308608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951610.170108:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951610.170124:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec5cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec5c8 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951610.170149:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec5c8 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951610.170161:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec5c8 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951610.170171:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4800, rc 0) 00000100:00100000:0.0:1783951610.170229:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624308608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951610.170236:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1783951610.170560:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624308608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951610.170577:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951610.170587:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951610.170653:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624308736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951610.170684:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951610.170716:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951610.171100:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624308736 00000100:00100000:1.0:1783951610.171107:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624308736 00000100:00100000:1.0:1783951610.171146:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783951610.171155:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624308736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.171507:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624308736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.171515:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1783951610.171909:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624308736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951610.171958:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624308864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951610.172005:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951610.172034:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951610.172064:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624308864 00000100:00100000:3.0:1783951610.172071:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624308864 00000100:00100000:3.0:1783951610.172159:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783951610.172169:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624308864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951610.172395:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624308864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951610.172403:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1783951610.172483:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624308864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951610.172967:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11546:1870608624308992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951610.173011:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951610.178738:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44cee540 going to sleep for 11 seconds 00000100:00100000:1.0:1783951610.179109:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624308992 00000100:00100000:1.0:1783951610.179120:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624308992 00000100:00100000:1.0:1783951610.179178:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783951610.179189:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:11546:x1870608624308992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951610.179509:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:11546:x1870608624308992:12345-0@lo:502:llog_process_th.0 Request processed in 320us (6495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.179520:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783951610.179733:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11546:1870608624308992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951610.179772:0:11546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951610.179785:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951610.179788:0:11546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783951610.179799:0:11546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8d7a084000 00000020:00000080:2.0:1783951610.179802:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783951610.179950:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11546:1870608624309120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951610.179989:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951610.180010:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44cee540 going to sleep for 11 seconds 00000100:00100000:3.0:1783951610.181684:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624309120 00000100:00100000:3.0:1783951610.181694:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624309120 00000100:00100000:3.0:1783951610.181741:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1783951610.181747:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:11546:x1870608624309120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951610.182005:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:11546:x1870608624309120:12345-0@lo:502:llog_process_th.0 Request processed in 256us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951610.182013:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1783951610.182100:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11546:1870608624309120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783951610.182132:0:11546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951610.182140:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951610.182143:0:11546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783951610.182149:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783951610.182339:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783951610.182356:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951610.182367:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951610.182389:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951610.182399:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951610.182401:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d604cd800 from 7 10000000:01000000:3.0:1783951610.182404:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951610.182436:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951610.182444:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951610.182453:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951610.182471:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624309248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951610.182510:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951610.182539:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951610.182552:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624309248 00000100:00100000:3.0:1783951610.182555:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624309248 00000100:00100000:3.0:1783951610.182578:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1783951610.182584:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:5788:x1870608624309248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951610.182593:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951610.183109:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d74ff9400/0x443dabd358eec5dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec5d6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951610.183136:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d74ff9400/0x443dabd358eec5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec5d6 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951610.183159:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d74ff9400/0x443dabd358eec5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec5d6 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951610.183167:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9400, rc 0) 00000100:00100000:3.0:1783951610.183202:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624309248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 618us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951610.183209:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1783951610.183967:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624309248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951610.183987:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951610.183998:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951610.184057:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624309376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951610.184092:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951610.185802:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951610.185863:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624309376 00000100:00100000:3.0:1783951610.185871:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624309376 00000100:00100000:3.0:1783951610.185936:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1783951610.185947:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5a5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624309376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951610.190763:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5a5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624309376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2654us (4507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951610.190786:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1783951610.190929:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624309376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951610.191006:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624309504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951610.191077:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951610.191135:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951610.191175:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624309504 00000100:00100000:3.0:1783951610.191182:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624309504 00000100:00100000:3.0:1783951610.193520:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1783951610.193541:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60acc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624309504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951610.194201:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60acc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:5788:x1870608624309504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 667us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951610.194210:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783951610.196448:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624309504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.196789:0:11548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11548:1870608624309632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951610.196903:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951610.196956:0:11548:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8145e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951610.197002:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624309632 00000100:00100000:1.0:1783951610.197009:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624309632 00000100:00100000:1.0:1783951610.197054:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783951610.197066:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:11548:x1870608624309632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951610.197401:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:11548:x1870608624309632:12345-0@lo:502:llog_process_th.0 Request processed in 336us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.197409:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783951610.197469:0:11548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11548:1870608624309632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951610.197493:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951610.197506:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951610.197508:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951610.197516:0:11548:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8d604cd800 00000020:00000080:1.0:1783951610.197518:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783951610.198030:0:11548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11548:1870608624309760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951610.198071:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951610.198092:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624309760 00000100:00100000:1.0:1783951610.198096:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624309760 00000100:00100000:1.0:1783951610.198120:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783951610.198127:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d50470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:11548:x1870608624309760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951610.198267:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d50470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:11548:x1870608624309760:12345-0@lo:502:llog_process_th.0 Request processed in 140us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.198274:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783951610.198316:0:11548:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8145e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951610.198334:0:11548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11548:1870608624309760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951610.198355:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951610.198361:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951610.198362:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783951610.198366:0:11548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783951610.198427:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783951610.198447:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951610.198458:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.198469:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951610.198479:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951610.198482:0:5788:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d4535a000 from 7 10000000:01000000:1.0:1783951610.198484:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951610.198510:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.198518:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.198528:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951610.198541:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624309888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.198566:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951610.198579:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8145e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951610.198593:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624309888 00000100:00100000:1.0:1783951610.198602:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624309888 00000100:00100000:1.0:1783951610.198621:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1783951610.198627:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d50473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:5788:x1870608624309888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951610.198635:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951610.198648:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d40031a00/0x443dabd358eec5eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eec5e4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.198673:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d40031a00/0x443dabd358eec5eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eec5e4 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.198683:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d40031a00/0x443dabd358eec5eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eec5e4 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.198692:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d40031a00, rc 0) 00000100:00100000:1.0:1783951610.198721:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d50473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:5788:x1870608624309888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.198727:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1783951610.198754:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624309888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951610.198767:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.198775:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951610.198847:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624310016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.198873:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951610.198890:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8145e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951610.198900:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624310016 00000100:00100000:1.0:1783951610.198908:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624310016 00000100:00100000:1.0:1783951610.198928:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783951610.198934:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:5788:x1870608624310016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.199151:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:5788:x1870608624310016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.199158:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783951610.199187:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624310016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.199211:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624310144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.199244:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951610.199256:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8145e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951610.199266:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624310144 00000100:00100000:1.0:1783951610.199270:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624310144 00000100:00100000:1.0:1783951610.199286:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783951610.199291:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:5788:x1870608624310144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.199422:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+20:5788:x1870608624310144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.199428:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783951610.199542:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:5788:1870608624310144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.208517:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11549:1870608624310272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951610.208717:0:11549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951610.208772:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8145e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951610.211311:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624310272 00000100:00100000:3.0:1783951610.211329:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624310272 00000100:00100000:3.0:1783951610.211419:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783951610.211431:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:11549:x1870608624310272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951610.211720:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:11549:x1870608624310272:12345-0@lo:502:llog_process_th.0 Request processed in 290us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951610.211729:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783951610.214084:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11549:1870608624310272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951610.214142:0:11549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951610.214159:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951610.214172:0:11549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951610.214180:0:11549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8d4535a000 00000020:00000080:1.0:1783951610.214183:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783951610.214305:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11549:1870608624310400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951610.214394:0:11549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951610.214434:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659ee0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951610.214933:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624310400 00000100:00100000:3.0:1783951610.214941:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624310400 00000100:00100000:3.0:1783951610.214998:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783951610.215007:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:11549:x1870608624310400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951610.215252:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:11549:x1870608624310400:12345-0@lo:502:llog_process_th.0 Request processed in 245us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951610.215261:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783951610.216153:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:11549:1870608624310400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951610.216197:0:11549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951610.216207:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951610.216209:0:11549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783951610.216214:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783951610.216600:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783951610.216630:0:5788:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951610.216650:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951610.216662:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951610.229099:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783951610.261156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951610.261716:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602256384 00000100:00100000:1.0:1783951610.261728:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602256384 00000100:00100000:1.0:1783951610.261977:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 260 00000100:00100000:1.0:1783951610.261989:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:5576:x1870608602256384:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951610.262008:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951610.262026:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d40031800/0x443dabd358eec5f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a03860c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.262057:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d40031800/0x443dabd358eec5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03860c expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.262070:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d40031800/0x443dabd358eec5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03860c expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.262079:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d40031800, rc 0) 00000100:00100000:1.0:1783951610.262161:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602256384:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.262178:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 260 00000100:00100000:0.0:1783951610.272155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951610.272236:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602256512 00000100:00100000:1.0:1783951610.272248:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602256512 00000100:00100000:1.0:1783951610.272363:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 261 00000100:00100000:1.0:1783951610.272377:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5850b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602256512:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.272726:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5850b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602256512:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 351us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.272736:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 261 00000100:00100000:0.0:1783951610.275332:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951610.275401:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602256640 00000100:00100000:1.0:1783951610.275409:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602256640 00000100:00100000:1.0:1783951610.275495:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 262 00000100:00100000:1.0:1783951610.275505:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602256640:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.275713:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602256640:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 209us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.275721:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 262 00000100:00100000:3.0:1783951610.279667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951610.279986:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602256768 00000100:00100000:1.0:1783951610.279999:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602256768 00000100:00100000:1.0:1783951610.280057:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 263 00000100:00100000:1.0:1783951610.280068:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:9936:x1870608602256768:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951610.280617:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:9936:x1870608602256768:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 549us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.280627:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 263 00000100:00100000:0.0:1783951610.283451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951610.283716:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602256896 00000100:00100000:1.0:1783951610.283726:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602256896 00000100:00100000:1.0:1783951610.283926:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 264 00000100:00100000:1.0:1783951610.283938:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:9936:x1870608602256896:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951610.284199:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:9936:x1870608602256896:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 262us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.284207:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 264 00000100:00100000:0.0:1783951610.286672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951610.286957:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602257024 00000100:00100000:1.0:1783951610.286969:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602257024 00000100:00100000:1.0:1783951610.287041:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 265 00000100:00100000:1.0:1783951610.287054:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:5576:x1870608602257024:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951610.287078:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951610.287102:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d40031000/0x443dabd358eec5f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038613 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.287137:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d40031000/0x443dabd358eec5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038613 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.287148:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d40031000/0x443dabd358eec5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038613 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951610.287159:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d40031000, rc 0) 00000100:00100000:1.0:1783951610.287222:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602257024:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 170us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.287228:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 265 00000100:00100000:3.0:1783951610.289096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951610.289233:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602257152 00000100:00100000:1.0:1783951610.289242:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602257152 00000100:00100000:1.0:1783951610.289299:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 266 00000100:00100000:1.0:1783951610.289308:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602257152:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951610.289678:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602257152:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 371us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.289688:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 266 00000100:00100000:0.0:1783951610.292127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951610.292223:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602257280 00000100:00100000:2.0:1783951610.292233:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602257280 00000100:00100000:2.0:1783951610.292296:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 267 00000100:00100000:2.0:1783951610.292308:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602257280:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951610.292935:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:5576:x1870608602257280:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 627us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951610.292944:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 267 00000100:00100000:3.0:1783951610.299424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951610.299500:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602257408 00000100:00100000:1.0:1783951610.299511:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602257408 00000100:00100000:1.0:1783951610.299580:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 268 00000100:00100000:1.0:1783951610.299590:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:9938:x1870608602257408:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951610.301466:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:9938:x1870608602257408:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 1862us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951610.301481:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 268 00000100:00100000:3.0:1783951610.305701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951610.305857:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602257536 00000100:00100000:2.0:1783951610.305874:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602257536 00000100:00100000:2.0:1783951610.305996:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 269 00000100:00100000:2.0:1783951610.306008:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:9938:x1870608602257536:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783951610.306318:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:9938:x1870608602257536:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 312us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951610.306327:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 269 00010000:00010000:0.0:1783951611.126306:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951611.254311:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624310528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951611.254395:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951611.255635:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624310528 00000100:00100000:0.0:1783951611.255647:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624310528 00000100:00100000:0.0:1783951611.255734:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951611.255749:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624310528:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783951611.256008:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783951611.256305:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000040:00080000:3.0:1783951611.256493:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783951611.256697:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624310528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 952us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951611.256706:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783951611.259078:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624310528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783951612.153527:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951612.282832:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951612.282860:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624310656:0@lo:400:kworker.0 00000100:00100000:1.0:1783951612.282952:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951612.283023:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624310656 00000100:00100000:1.0:1783951612.283030:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624310656 00000100:00100000:1.0:1783951612.283076:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783951612.283096:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624310656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951612.283147:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624310656:12345-0@lo:400:kworker.0 Request processed in 52us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951612.283154:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783951612.283196:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624310656:0@lo:400:kworker.0 00000100:00100000:3.0:1783951612.283450:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624310784:0@lo:400:kworker.0 00000100:00100000:3.0:1783951612.283484:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951612.283622:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624310784 00000100:00100000:1.0:1783951612.283627:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624310784 00000100:00100000:1.0:1783951612.283664:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783951612.283672:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624310784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951612.283731:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624310784:12345-0@lo:400:kworker.0 Request processed in 60us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951612.283738:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783951612.283868:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624310784:0@lo:400:kworker.0 00000100:00100000:0.0:1783951612.284053:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624310912:0@lo:400:kworker.0 00000100:00100000:0.0:1783951612.284085:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951612.284108:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951612.284114:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624311296:0@lo:400:kworker.0 00000100:00100000:0.0:1783951612.284140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951612.284168:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624310912 00000100:00100000:0.0:1783951612.284172:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624310912 00000100:00100000:0.0:1783951612.284213:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783951612.284220:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624310912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951612.284257:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624310912:12345-0@lo:400:kworker.0 Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951612.284264:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1783951612.284284:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951612.284303:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624310912:0@lo:400:kworker.0 00000100:00100000:3.0:1783951612.284366:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624311168:0@lo:400:kworker.0 00000100:00100000:3.0:1783951612.284394:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951612.284418:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951612.284424:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624311040:0@lo:400:kworker.0 00000100:00100000:3.0:1783951612.284446:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951612.284515:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624311296 00000100:00100000:2.0:1783951612.284519:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624311296 00000100:00100000:2.0:1783951612.284559:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624311040 00000100:00100000:2.0:1783951612.284562:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624311040 00000100:00100000:2.0:1783951612.284584:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951612.284590:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624311296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951612.284627:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624311296:12345-0@lo:400:kworker.0 Request processed in 37us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951612.284634:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951612.284645:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951612.284652:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624311040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951612.284697:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624311040:12345-0@lo:400:kworker.0 Request processed in 31us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951612.284704:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951612.284733:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624311040:0@lo:400:kworker.0 00000100:00100000:0.0:1783951612.284890:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624311168 00000100:00100000:0.0:1783951612.284894:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624311168 00000100:00100000:0.0:1783951612.284932:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783951612.284948:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624311168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951612.284986:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624311168:12345-0@lo:400:kworker.0 Request processed in 40us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951612.284992:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1783951612.285021:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7f768700 x1870608624311296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951612.285031:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624311296:0@lo:400:kworker.0 00000100:00100000:0.0:1783951612.285052:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624311168:0@lo:400:kworker.0 00000100:00080000:3.0:1783951612.285106:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951612.285110:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951612.790475:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951612.790500:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624311424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951612.790571:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951612.790709:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624311424 00000100:00100000:0.0:1783951612.790717:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624311424 00000100:00100000:0.0:1783951612.790776:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951612.790787:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624311424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951612.790854:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951612.790902:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624311424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951612.790908:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1783951612.790997:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7f76a300 x1870608624311424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951612.791013:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624311424:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951613.174142:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951613.265768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951613.265849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951613.265901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951613.265920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951613.265944:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602257792 00000100:00100000:0.0:1783951613.265951:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602257792 00000100:00100000:0.0:1783951613.266013:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602258048 00000100:00100000:0.0:1783951613.266015:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602258048 00000100:00100000:0.0:1783951613.266029:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:0.0:1783951613.266037:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602257792:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951613.266135:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602257792:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951613.266143:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:0.0:1783951613.266162:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:0.0:1783951613.266168:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602258048:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951613.266193:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602258048:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951613.266199:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:3.0:1783951613.266296:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602257920 00000100:00100000:3.0:1783951613.266300:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602257920 00000100:00100000:3.0:1783951613.266325:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:3.0:1783951613.266330:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602257920:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951613.266351:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602257920:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 22us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951613.266355:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00080000:3.0:1783951613.266498:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951613.266503:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951613.267371:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602257664 00000100:00100000:2.0:1783951613.267377:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602257664 00000100:00100000:2.0:1783951613.267418:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 271 00000100:00100000:2.0:1783951613.267425:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602257664:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951613.267907:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602257664:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 52us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951613.267917:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 271 00000001:00080000:1.0:1783951613.380997:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1783951614.202990:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951615.222213:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951616.246245:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951616.374108:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951616.374136:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624311552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951616.374215:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951616.374513:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624311552 00000100:00100000:1.0:1783951616.374523:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624311552 00000100:00080000:3.0:1783951616.374921:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951616.375125:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951616.375140:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624311552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951616.375187:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951616.375279:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624311552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951616.375289:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783951616.375366:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1783951616.375372:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d7593c000, transno 4294967300 00000100:00100000:0.0:1783951616.375400:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624311552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951617.271456:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951617.398299:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951617.398336:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624311680:0@lo:400:kworker.0 00000100:00100000:1.0:1783951617.398407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951617.398474:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624311680 00000100:00100000:1.0:1783951617.398481:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624311680 00000100:00100000:1.0:1783951617.398525:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1783951617.398535:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624311680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951617.398587:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624311680:12345-0@lo:400:kworker.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951617.398840:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1783951617.398891:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624311680:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.398962:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624311808:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.398995:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951617.399027:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951617.399033:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624311936:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951617.399077:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624311808 00000100:00100000:3.0:1783951617.399080:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624311808 00000100:00100000:3.0:1783951617.399109:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624311936 00000100:00100000:3.0:1783951617.399112:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624311936 00000100:00100000:3.0:1783951617.399136:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783951617.399142:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624311808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399174:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624311808:12345-0@lo:400:kworker.0 Request processed in 32us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951617.399180:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783951617.399191:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783951617.399197:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624311936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399241:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624311936:12345-0@lo:400:kworker.0 Request processed in 44us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951617.399247:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1783951617.399265:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951617.399285:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624311936:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399294:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624311808:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399557:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624312320:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951617.399775:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624312064:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399796:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951617.399826:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951617.399831:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624312192:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399848:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951617.399867:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624312320 00000100:00100000:3.0:1783951617.399870:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624312320 00000100:00100000:3.0:1783951617.399895:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624312064 00000100:00100000:3.0:1783951617.399897:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624312064 00000100:00100000:3.0:1783951617.399911:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783951617.399916:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624312320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399944:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624312320:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951617.399949:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783951617.399959:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783951617.399963:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624312064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.399986:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624312064:12345-0@lo:400:kworker.0 Request processed in 22us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951617.399996:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1783951617.400011:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951617.400017:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624312192 00000100:00100000:3.0:1783951617.400019:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624312192 00000100:00100000:3.0:1783951617.400036:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783951617.400041:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624312192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.400062:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624312192:12345-0@lo:400:kworker.0 Request processed in 21us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951617.400067:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1783951617.400078:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783951617.400093:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7f768e00 x1870608624312320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951617.400103:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624312320:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.400121:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624312192:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.400128:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624312064:0@lo:400:kworker.0 00000100:00100000:3.0:1783951617.911659:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951617.911686:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624312448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951617.911789:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951617.912328:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624312448 00000100:00100000:0.0:1783951617.912339:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624312448 00000100:00100000:0.0:1783951617.912413:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951617.912425:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624312448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951617.912481:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951617.912545:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624312448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951617.912554:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1783951617.912863:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7f768a80 x1870608624312448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951617.912885:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624312448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951618.294147:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951618.386171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951618.386212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951618.386272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951618.386305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951618.386306:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602258304 00000100:00100000:1.0:1783951618.386315:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602258304 00000100:00100000:3.0:1783951618.386367:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602258560 00000100:00100000:3.0:1783951618.386371:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602258560 00000100:00100000:2.0:1783951618.386413:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602258176 00000100:00100000:2.0:1783951618.386417:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602258176 00000100:00100000:2.0:1783951618.386453:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 273 00000100:00100000:1.0:1783951618.386453:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:2.0:1783951618.386462:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602258176:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:0.0:1783951618.386496:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951618.386550:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602258176:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951618.386558:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 273 00000100:00100000:2.0:1783951618.386725:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602258432 00000100:00100000:2.0:1783951618.386729:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602258432 00000100:00100000:2.0:1783951618.386761:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1783951618.386767:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602258432:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951618.386802:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602258432:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951618.386844:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:3.0:1783951618.390268:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:3.0:1783951618.390295:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602258560:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951618.390383:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602258560:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 92us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951618.390390:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:1.0:1783951618.392351:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602258304:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951618.392449:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602258304:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 5986us (6286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951618.392461:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00080000:0.0:1783951618.395468:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783951619.318469:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951620.342459:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951621.366330:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951621.494477:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783951621.495261:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951621.495286:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624312576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951621.495367:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951621.495580:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624312576 00000100:00100000:0.0:1783951621.495591:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624312576 00000100:00100000:0.0:1783951621.495695:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951621.495706:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624312576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951621.495762:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951621.495845:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624312576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951621.495854:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783951621.495971:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624312576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783951621.498417:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951622.393947:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951622.518669:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624312704:0@lo:400:kworker.0 00000100:00100000:2.0:1783951622.518761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951622.518790:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624312832:0@lo:400:kworker.0 00000100:00100000:1.0:1783951622.518844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951622.518856:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624312704 00000100:00100000:2.0:1783951622.518863:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624312704 00000100:00100000:3.0:1783951622.518967:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624312832 00000100:00100000:3.0:1783951622.518971:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624312832 00000100:00100000:3.0:1783951622.519023:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783951622.519033:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624312832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951622.519119:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783951622.519125:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624312704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951622.519162:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624312704:12345-0@lo:400:kworker.0 Request processed in 36us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951622.519168:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783951622.519245:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624312704:0@lo:400:kworker.0 00000100:00100000:2.0:1783951622.519530:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624312960:0@lo:400:kworker.0 00000100:00100000:2.0:1783951622.519559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951622.519588:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624312960 00000100:00100000:2.0:1783951622.519592:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624312960 00000100:00100000:2.0:1783951622.519638:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783951622.519645:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624312960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951622.519679:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624312960:12345-0@lo:400:kworker.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951622.519685:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783951622.519714:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624312960:0@lo:400:kworker.0 00000100:00080000:2.0:1783951622.519737:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951622.526533:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624312832:12345-0@lo:400:kworker.0 Request processed in 7490us (7677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951622.526549:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783951622.526688:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951622.526692:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624313088:0@lo:400:kworker.0 00000100:00100000:0.0:1783951622.526698:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624313344:0@lo:400:kworker.0 00000100:00100000:2.0:1783951622.526763:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624313216:0@lo:400:kworker.0 00000100:00100000:0.0:1783951622.531364:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951622.531446:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624313344 00000100:00100000:0.0:1783951622.531455:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624313344 00000100:00100000:0.0:1783951622.531520:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783951622.531531:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624313344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951622.531595:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624313344:12345-0@lo:400:kworker.0 Request processed in 66us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951622.531603:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1783951622.531644:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783951622.531677:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7f768a80 x1870608624313344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951622.531691:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624313344:0@lo:400:kworker.0 00000100:00100000:3.0:1783951622.534566:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951622.534653:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624313088 00000100:00100000:3.0:1783951622.534663:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624313088 00000100:00100000:3.0:1783951622.534716:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783951622.534725:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624313088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951622.534788:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624313088:12345-0@lo:400:kworker.0 Request processed in 64us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951622.534795:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783951622.534853:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624313088:0@lo:400:kworker.0 00000100:00100000:2.0:1783951622.536341:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951622.539020:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624313216 00000100:00100000:3.0:1783951622.539035:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624313216 00000100:00100000:3.0:1783951622.539298:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783951622.539314:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624313216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951622.539490:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624313216:12345-0@lo:400:kworker.0 Request processed in 183us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951622.539498:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783951622.539546:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624313216:0@lo:400:kworker.0 00000100:00080000:0.0:1783951622.539697:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951622.539862:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624312832:0@lo:400:kworker.0 00000100:00100000:2.0:1783951623.031669:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624313472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951623.031745:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951623.031904:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624313472 00000100:00100000:1.0:1783951623.031916:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624313472 00000100:00100000:1.0:1783951623.031980:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783951623.031992:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624313472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951623.032040:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951623.036976:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624313472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4974us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951623.036994:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1783951623.037201:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7f768a80 x1870608624313472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951623.037228:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624313472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783951623.413987:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951623.516693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951623.516746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951623.516787:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602258688 00000100:00100000:1.0:1783951623.516853:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602258688 00000100:00100000:1.0:1783951623.516917:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 275 00000100:00100000:1.0:1783951623.516929:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602258688:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951623.517014:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602258688:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951623.517022:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 275 00000100:00100000:3.0:1783951623.517315:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602258816 00000100:00100000:3.0:1783951623.517321:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602258816 00000100:00100000:3.0:1783951623.517377:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:3.0:1783951623.517386:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602258816:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:0.0:1783951623.517401:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951623.517438:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602258816:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 54us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951623.517444:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:2.0:1783951623.521027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951623.522766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951623.523473:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602258944 00000100:00100000:3.0:1783951623.523476:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602259072 00000100:00100000:3.0:1783951623.523484:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602259072 00000100:00100000:0.0:1783951623.523484:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602258944 00000100:00100000:3.0:1783951623.523898:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:3.0:1783951623.523910:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602259072:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951623.524004:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602259072:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 95us (2988us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951623.524012:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:0.0:1783951623.527511:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1783951623.527530:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2357:x1870608602258944:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:0.0:1783951623.527568:0:8067:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec535 00000100:00080000:0.0:1783951623.527578:0:8067:0:(import.c:65:import_set_state_nolock()) ffff8e8d75776800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951623.527636:0:8067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1783951623.527647:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951623.527968:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+2:2357:x1870608602258944:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 442us (5206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951623.527976:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00080000:2.0:1783951623.531917:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951623.531931:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1783951623.660082:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:1.0:1783951623.660092:0:6615:0:(genops.c:906:class_export_put()) final put ffff8e8d75773800/65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:0.0:1783951623.660652:0:477:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d75773800/65c652b5-a392-4c36-a8f6-f2bd53c90279 for lustre-OST0000 00000020:00000080:0.0:1783951623.660714:0:477:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d75776800 for lustre-OST0000 00010000:00010000:1.0:1783951624.438983:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951625.464972:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951626.488150:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951626.616210:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624313600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951626.616271:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951626.616367:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624313600 00000100:00100000:1.0:1783951626.616373:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624313600 00000100:00100000:1.0:1783951626.616422:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951626.616430:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624313600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951626.616460:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951626.616495:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624313600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951626.616502:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1783951626.616573:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951626.616612:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624313600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783951627.511518:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951627.638997:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624313984:0@lo:400:kworker.0 00000100:00100000:2.0:1783951627.639088:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951627.639149:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783951627.639155:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624313856:0@lo:400:kworker.0 00000100:00100000:2.0:1783951627.639180:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951627.639198:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624314368:0@lo:400:kworker.0 00000100:00100000:2.0:1783951627.639220:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951627.639261:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624313984 00000100:00100000:2.0:1783951627.639269:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624313984 00000100:00100000:2.0:1783951627.639321:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624313856 00000100:00100000:2.0:1783951627.639324:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624313856 00000100:00100000:2.0:1783951627.639347:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783951627.639356:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624313984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951627.639407:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624313728:0@lo:400:kworker.0 00000100:00100000:2.0:1783951627.639410:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624313984:12345-0@lo:400:kworker.0 Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951627.639419:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783951627.639438:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783951627.639446:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624313856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951627.639459:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951627.639490:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624314240:0@lo:400:kworker.0 00000100:00100000:3.0:1783951627.639516:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951627.639531:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951627.639546:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624314112:0@lo:400:kworker.0 00000100:00100000:3.0:1783951627.639571:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951627.639604:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624314240 00000100:00100000:3.0:1783951627.639608:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624314240 00000100:00100000:3.0:1783951627.639637:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783951627.639645:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624314240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951627.639677:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624313728 00000100:00100000:1.0:1783951627.639683:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624313728 00000100:00100000:3.0:1783951627.639687:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624314240:12345-0@lo:400:kworker.0 Request processed in 41us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951627.639695:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783951627.639719:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1783951627.639720:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624314368 00000100:00100000:3.0:1783951627.639725:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624314368 00000100:00100000:1.0:1783951627.639731:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624313728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951627.639756:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624314112 00000100:00100000:3.0:1783951627.639761:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624314112 00000100:00100000:1.0:1783951627.639771:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624313728:12345-0@lo:400:kworker.0 Request processed in 42us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951627.639777:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1783951627.639785:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783951627.639794:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624314368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951627.639848:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783951627.639856:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624314112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951627.639891:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624314112:12345-0@lo:400:kworker.0 Request processed in 37us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951627.639899:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1783951627.639919:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951627.639924:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951627.640056:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624313984:0@lo:400:kworker.0 00000100:00100000:3.0:1783951627.640150:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624314368:12345-0@lo:400:kworker.0 Request processed in 357us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951627.640158:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783951627.640187:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624314112:0@lo:400:kworker.0 00000100:00100000:3.0:1783951627.640196:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624313728:0@lo:400:kworker.0 00000100:00100000:3.0:1783951627.640205:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624314240:0@lo:400:kworker.0 00000100:00100000:2.0:1783951627.640709:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624313856:12345-0@lo:400:kworker.0 Request processed in 1262us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951627.640716:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783951627.640873:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624313856:0@lo:400:kworker.0 00010000:00080000:1.0:1783951627.640887:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7a1c9500 x1870608624314368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951627.640897:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624314368:0@lo:400:kworker.0 00000100:00100000:1.0:1783951628.151001:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624314496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951628.151220:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951628.151373:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624314496 00000100:00100000:3.0:1783951628.151381:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624314496 00000100:00100000:3.0:1783951628.151441:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783951628.151450:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624314496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951628.151492:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951628.151554:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624314496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951628.151561:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1783951628.151645:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d7f769180 x1870608624314496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951628.151666:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624314496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951628.533989:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951628.624911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951628.624963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951628.624991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951628.625093:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602259328 00000100:00100000:0.0:1783951628.625103:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602259328 00000100:00100000:0.0:1783951628.625164:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602259456 00000100:00100000:0.0:1783951628.625166:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602259456 00000100:00100000:0.0:1783951628.625192:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:0.0:1783951628.625202:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602259328:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951628.625281:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602259328:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 80us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951628.625302:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:0.0:1783951628.625322:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:0.0:1783951628.625330:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602259456:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951628.625353:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602259456:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951628.625360:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:2.0:1783951628.625450:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602259200 00000100:00100000:2.0:1783951628.625454:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602259200 00000100:00100000:2.0:1783951628.625480:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 277 00000100:00100000:2.0:1783951628.625487:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602259200:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951628.625515:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602259200:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951628.625548:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 277 00000100:00080000:3.0:1783951628.625623:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783951629.560909:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951630.582035:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951631.612779:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951631.734462:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783951631.736752:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951631.736782:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624314624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951631.736901:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951631.737118:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624314624 00000100:00100000:1.0:1783951631.737129:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624314624 00000100:00100000:1.0:1783951631.737191:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783951631.737202:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624314624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951631.737247:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951631.737298:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624314624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951631.737306:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1783951631.737329:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951631.737385:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624314624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951632.630099:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951632.758205:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624315008:0@lo:400:kworker.0 00000100:00100000:1.0:1783951632.758288:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951632.758368:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783951632.758375:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624314880:0@lo:400:kworker.0 00000100:00100000:1.0:1783951632.758424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951632.758445:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624315392:0@lo:400:kworker.0 00000100:00100000:1.0:1783951632.758480:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951632.758511:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624315008 00000100:00100000:1.0:1783951632.758520:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624315008 00000100:00100000:0.0:1783951632.758573:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624314880 00000100:00100000:0.0:1783951632.758580:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624314880 00000100:00100000:1.0:1783951632.758590:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783951632.758604:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624315008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951632.758619:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783951632.758628:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624314880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951632.758671:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624315008:12345-0@lo:400:kworker.0 Request processed in 70us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951632.758682:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624314880:12345-0@lo:400:kworker.0 Request processed in 54us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951632.758683:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783951632.758694:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783951632.758713:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624315392 00000100:00100000:1.0:1783951632.758718:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624315392 00000100:00080000:0.0:1783951632.758742:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951632.758748:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951632.758752:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783951632.758762:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624315392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951632.758790:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624314880:0@lo:400:kworker.0 00000100:00100000:1.0:1783951632.758798:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624315392:12345-0@lo:400:kworker.0 Request processed in 37us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951632.758806:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1783951632.758834:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d81444000 x1870608624315392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951632.758848:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624315392:0@lo:400:kworker.0 00000100:00100000:0.0:1783951632.758875:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624315008:0@lo:400:kworker.0 00000100:00100000:3.0:1783951632.758928:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624315136:0@lo:400:kworker.0 00000100:00100000:3.0:1783951632.758961:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951632.758998:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783951632.759005:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624314752:0@lo:400:kworker.0 00000100:00100000:3.0:1783951632.759032:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951632.759059:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624315264:0@lo:400:kworker.0 00000100:00100000:3.0:1783951632.759080:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951632.759105:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624315264 00000100:00100000:3.0:1783951632.759109:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624315264 00000100:00100000:3.0:1783951632.759139:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783951632.759145:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624315264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951632.759178:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870608624315264:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951632.759195:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1783951632.759211:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951632.759231:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624315264:0@lo:400:kworker.0 00000100:00100000:0.0:1783951632.759515:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624315136 00000100:00100000:0.0:1783951632.759520:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624315136 00000100:00100000:0.0:1783951632.759569:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783951632.759577:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624315136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951632.759629:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624315136:12345-0@lo:400:kworker.0 Request processed in 53us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951632.759636:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783951632.759715:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624315136:0@lo:400:kworker.0 00000100:00100000:1.0:1783951632.759762:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624314752 00000100:00100000:1.0:1783951632.759767:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624314752 00000100:00100000:1.0:1783951632.759802:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1783951632.759836:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624314752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951632.759895:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624314752:12345-0@lo:400:kworker.0 Request processed in 86us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951632.759904:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1783951632.760556:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624314752:0@lo:400:kworker.0 00000100:00100000:1.0:1783951633.272923:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951633.272965:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624315520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951633.273066:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951633.273143:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624315520 00000100:00100000:1.0:1783951633.273151:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624315520 00000100:00100000:1.0:1783951633.273206:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783951633.273216:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624315520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951633.273265:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951633.273319:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624315520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951633.273327:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1783951633.273374:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d60b89880 x1870608624315520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951633.273393:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624315520:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1783951633.631723:0:11717:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:07:12 (1783951632) 00010000:00010000:0.0:1783951633.654069:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951633.754427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951633.754629:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602259584 00000100:00100000:1.0:1783951633.754641:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602259584 00000100:00100000:1.0:1783951633.754703:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 279 00000100:00100000:1.0:1783951633.754715:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2358:x1870608602259584:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951633.754796:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2358:x1870608602259584:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951633.754804:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 279 00000100:00100000:3.0:1783951633.755633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951633.755676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951633.755700:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602259840 00000100:00100000:3.0:1783951633.755705:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602259840 00000100:00100000:3.0:1783951633.755748:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602259712 00000100:00100000:3.0:1783951633.755750:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602259712 00000100:00100000:3.0:1783951633.755769:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1783951633.755776:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602259840:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951633.756025:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602259840:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 248us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951633.756032:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1783951633.756051:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:3.0:1783951633.756057:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602259712:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951633.756086:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602259712:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951633.756092:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00080000:3.0:1783951633.756116:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783951634.679325:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951635.252390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951635.252838:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602259968 00000100:00100000:3.0:1783951635.252856:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602259968 00000100:00100000:3.0:1783951635.252938:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1783951635.252952:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:10208:x1870608602259968:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951635.252974:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951635.253041:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03861a expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.253104:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec607 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.253120:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.253134:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951635.253514:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1783951635.253706:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783951635.253712:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951635.254099:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.254136:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03861a expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.254155:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03861a expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.254165:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:3.0:1783951635.254168:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951635.254172:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8600, rc 0) 00000100:00100000:3.0:1783951635.254292:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:10208:x1870608602259968:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1343us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951635.254300:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:1.0:1783951635.264027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951635.264172:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602260096 00000100:00100000:3.0:1783951635.264182:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602260096 00000100:00100000:3.0:1783951635.264300:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1783951635.264312:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:10209:x1870608602260096:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951635.264336:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951635.264365:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec60e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038621 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.264451:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.264467:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.264479:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.264492:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.264508:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.264514:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265032:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9600/0x443dabd358eec623 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265049:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9600/0x443dabd358eec623 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265057:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9600/0x443dabd358eec623 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951635.265146:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783951635.265150:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951635.265221:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9600/0x443dabd358eec623 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265232:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265238:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265245:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265252:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951635.265256:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265263:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265273:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:3.0:1783951635.265276:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951635.265280:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265294:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265307:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265313:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265318:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265322:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951635.265325:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265330:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265337:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e8d821cfd00) 00010000:00010000:3.0:1783951635.265340:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951635.265342:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265347:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec61c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265378:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec60e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038621 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265391:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9600/0x443dabd358eec623 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038621 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951635.265405:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8d821cf800) 00010000:00010000:3.0:1783951635.265418:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951635.265420:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9600, rc 0) 00000100:00100000:3.0:1783951635.266937:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:10209:x1870608602260096:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 2618us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951635.266951:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1783951635.279112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951635.282966:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602260352 00000100:00100000:1.0:1783951635.282985:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602260352 00000100:00100000:1.0:1783951635.283128:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1783951635.283142:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:10209:x1870608602260352:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951635.283177:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951635.283387:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec62a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038628 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.283598:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.283616:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.283629:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.283660:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.283667:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.283673:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.285837:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec63f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.285864:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec63f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.285886:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec63f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951635.285903:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1783951635.286187:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286195:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286202:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286208:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5fc00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951635.286212:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286220:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286234:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8d821cf800) 00010000:00010000:1.0:1783951635.286238:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951635.286244:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286250:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec631 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286265:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286271:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286300:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286306:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951635.286309:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286316:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286323:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8d71d6d000) 00010000:00010000:1.0:1783951635.286325:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951635.286328:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.286334:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec638 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.289292:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec62a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038628 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.289319:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec63f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038628 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951635.289328:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:1.0:1783951635.289331:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951635.289334:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5f800, rc 0) 00000100:00100000:1.0:1783951635.290631:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:10209:x1870608602260352:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 7479us (11522us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783951635.290667:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:0.0:1783951635.304154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951635.304340:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602260480 00000100:00100000:1.0:1783951635.304351:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602260480 00000100:00100000:1.0:1783951635.304442:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1783951635.304455:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:10209:x1870608602260480:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783951635.304659:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:10209:x1870608602260480:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 205us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951635.304668:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00010000:00010000:3.0:1783951635.704604:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951635.830536:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783951636.731508:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951636.854122:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624315648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951636.854200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951636.854840:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624315648 00000100:00100000:1.0:1783951636.854850:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624315648 00000100:00100000:1.0:1783951636.854914:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783951636.854926:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624315648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951636.854965:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951636.855018:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624315648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951636.855026:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1783951636.855080:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951636.855128:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624315648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951637.243508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951637.243581:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602260608 00000100:00100000:3.0:1783951637.243594:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602260608 00000100:00100000:3.0:1783951637.243677:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1783951637.243687:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:10252:x1870608602260608:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951637.243847:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951637.243870:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec64d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03862f expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244147:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244163:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244178:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244195:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244203:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244210:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244541:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244549:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244556:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244563:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951637.244575:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244585:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244597:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951637.244601:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951637.244606:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244613:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244633:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244640:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244646:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244652:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951637.244656:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244662:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244669:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8d44e70500) 00010000:00010000:2.0:1783951637.244671:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951637.244679:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.244685:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec65b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951637.244995:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783951637.245049:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec64d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03862f expref: 10 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.245061:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951637.245144:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951637.245151:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec64d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03862f expref: 10 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.245168:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8800, rc 0) 00000100:00100000:2.0:1783951637.245245:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:10252:x1870608602260608:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1558us (1746us total) trans 0 rc 301/301 00000100:00100000:2.0:1783951637.245254:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:0.0:1783951637.253854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951637.253940:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602260864 00000100:00100000:3.0:1783951637.253957:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602260864 00000100:00100000:3.0:1783951637.254034:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1783951637.254046:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:10252:x1870608602260864:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:3.0:1783951637.254119:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951637.254163:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec607 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03861a expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.254184:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:3.0:1783951637.254194:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951637.254503:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.254519:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.254529:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.254541:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.254548:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.254555:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951637.255624:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783951637.255635:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.255644:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.255650:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.255667:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951637.255672:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.255679:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.255692:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:3.0:1783951637.255695:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951637.255700:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.255705:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec662 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951637.255723:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000437acde0 reply state 0000000005456798 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951637.255732:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951637.255876:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:10252:x1870608602260864:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 1828us (2084us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783951637.255884:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00010000:00010000:3.0:1783951637.259981:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.259999:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.260009:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.260033:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951637.260038:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.260047:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.260063:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8d821cf400) 00010000:00010000:3.0:1783951637.260354:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951637.260363:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.260370:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec669 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951637.364271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951637.364320:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602260992 00000100:00100000:0.0:1783951637.364331:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602260992 00000100:00100000:0.0:1783951637.364401:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:0.0:1783951637.364413:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:10260:x1870608602260992:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:0.0:1783951637.364444:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951637.364473:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038636 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.364551:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eec677 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.364565:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eec677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.364588:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eec677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951637.364661:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783951637.364666:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783951637.364706:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eec677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.364732:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038636 expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.364750:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eec677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038636 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.364758:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:0.0:1783951637.364760:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951637.364764:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5a00, rc 0) 00000100:00100000:0.0:1783951637.364850:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:10260:x1870608602260992:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 440us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951637.364858:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:0.0:1783951637.422141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951637.422318:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602261120 00000100:00100000:3.0:1783951637.422329:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602261120 00000100:00100000:3.0:1783951637.422393:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:3.0:1783951637.422404:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:10266:x1870608602261120:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1783951637.422423:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951637.422444:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec67e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03863d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422503:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422517:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422528:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422558:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422565:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422572:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422689:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422698:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.422705:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951637.423261:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783951637.423265:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951637.423305:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423318:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423325:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423331:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423348:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951637.423352:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423360:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423383:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:3.0:1783951637.423386:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951637.423391:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423397:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423409:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423414:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423420:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423425:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951637.423427:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423433:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423449:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8d821cf400) 00010000:00010000:3.0:1783951637.423452:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951637.423455:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423461:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec68c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423493:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec67e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03863d expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423506:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03863d expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.423513:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:3.0:1783951637.423516:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783951637.423518:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9c00, rc 0) 00000100:00100000:3.0:1783951637.423587:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:10266:x1870608602261120:12345-192.168.201.6@tcp:101:bash.0 Request processed in 1184us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951637.423595:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1783951637.426551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951637.426630:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602261376 00000100:00100000:2.0:1783951637.426639:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602261376 00000100:00100000:2.0:1783951637.426720:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1783951637.426731:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:10266:x1870608602261376:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951637.426758:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951637.426782:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec69a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038644 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.426973:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.426989:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427013:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427029:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427035:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427040:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783951637.427649:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1783951637.427863:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427873:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427882:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427919:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427927:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427934:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427942:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951637.427952:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427961:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427975:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:2.0:1783951637.427978:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951637.427982:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.427988:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec6a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951637.428001:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000680dcebb reply state 000000004a1d3f7c transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951637.428009:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783951637.428041:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec69a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.428055:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.428063:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d44e70e00) 00010000:00010000:2.0:1783951637.428065:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951637.428067:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:2.0:1783951637.428148:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:10266:x1870608602261376:12345-192.168.201.6@tcp:101:bash.0 Request processed in 1419us (1608us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783951637.428157:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00010000:00010000:0.0:1783951637.435466:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.435483:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.435492:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.435512:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951637.435517:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.435525:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.435543:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d44e70500) 00010000:00010000:0.0:1783951637.435546:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951637.435550:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.435556:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec6a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951637.436334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.436411:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602261504 00000100:00100000:1.0:1783951637.436421:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602261504 00000100:00100000:1.0:1783951637.436468:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783951637.436476:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1870608602261504:12345-192.168.201.6@tcp:8:bash.0 00010000:00080000:1.0:1783951637.436510:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:1.0:1783951637.436541:0:6590:0:(genops.c:1406:class_connect()) connect: client 65c652b5-a392-4c36-a8f6-f2bd53c90279, cookie 0x443dabd358eec6bd 00002000:00100000:1.0:1783951637.436553:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 65c652b5-a392-4c36-a8f6-f2bd53c90279/ffff8e8d448ca000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783951637.436590:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951637.436803:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783951637.436861:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8e8d448cf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951637.436919:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2357:x1870608602261504:12345-192.168.201.6@tcp:8:bash.0 Request processed in 441us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951637.436927:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783951637.440056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951637.440128:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602261632 00000100:00100000:0.0:1783951637.440139:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602261632 00000100:00100000:0.0:1783951637.440215:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783951637.440227:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:0:x1870608602261632:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1783951637.440246:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1783951637.440270:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783951637.440271:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03864b expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951637.440300:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951637.440318:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1783951637.440323:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951637.440332:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.440367:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.440392:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5800, rc 0) 00000100:00100000:0.0:1783951637.440451:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:0:x1870608602261632:12345-192.168.201.6@tcp:101:bash.0 Request processed in 227us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951637.440458:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783951637.447390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.447492:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602261760 00000100:00100000:1.0:1783951637.447503:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602261760 00000100:00100000:1.0:1783951637.447657:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1783951637.447687:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:10266:x1870608602261760:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951637.447706:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951637.447727:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038652 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.447760:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.447769:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951637.447774:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951637.447779:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.447855:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.447875:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 8 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951637.447908:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6590:1870608624315776:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951637.448018:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7592dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951637.455197:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951637.455273:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602261888 00000100:00100000:0.0:1783951637.455282:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602261888 00010000:00010000:0.0:1783951637.455327:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 9 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951637.455382:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:0.0:1783951637.455391:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2359:x1870608602261888:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951637.455408:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951637.455437:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 9 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.455453:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 9 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.455483:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951637.455488:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951637.455520:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.455531:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.455576:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951637.455593:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5778:1870608624315904:192.168.201.6@tcp:105: 00000100:00100000:0.0:1783951637.455698:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81563c00 going to sleep for 11 seconds 00010000:00010000:1.0:1783951637.456022:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eec6c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03864b expref: 9 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951637.456039:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6590:1870608624315776:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951637.456064:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.456076:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5e600, rc 0) 00000100:00100000:1.0:1783951637.456121:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:10266:x1870608602261760:12345-192.168.201.6@tcp:101:bash.0 Request processed in 8454us (8751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951637.456128:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1783951637.461672:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5778:1870608624315904:192.168.201.6@tcp:105: 00010000:00010000:0.0:1783951637.461702:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951637.461960:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602261888:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 6567us (6773us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951637.461973:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:0.0:1783951637.467121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.467310:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602262144 00000100:00100000:1.0:1783951637.467320:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602262144 00000100:00100000:1.0:1783951637.467387:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1783951637.467398:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:10266:x1870608602262144:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:1.0:1783951637.467769:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:10266:x1870608602262144:12345-192.168.201.6@tcp:35:bash.0 Request processed in 371us (656us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783951637.467776:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1783951637.544399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951637.544523:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602262400 00000100:00100000:3.0:1783951637.544535:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602262400 00000100:00100000:3.0:1783951637.545543:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:3.0:1783951637.545560:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:10276:x1870608602262400:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951637.545590:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951637.545627:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec6d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951637.545782:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783951637.546650:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec6d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038659 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.546666:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:2.0:1783951637.546670:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951637.546675:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec6d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038659 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.546690:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8200, rc 0) 00000100:00100000:2.0:1783951637.546778:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:10276:x1870608602262400:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1223us (2397us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1783951637.546786:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:0.0:1783951637.551228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.551415:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602262656 00000100:00100000:1.0:1783951637.551426:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602262656 00000100:00100000:1.0:1783951637.551489:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783951637.551498:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:10276:x1870608602262656:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951637.551862:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:10276:x1870608602262656:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 364us (643us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783951637.551879:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783951637.613021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951637.613174:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602262784 00000100:00100000:2.0:1783951637.613186:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602262784 00000100:00100000:2.0:1783951637.613270:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:2.0:1783951637.613283:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:10282:x1870608602262784:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951637.613315:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951637.613336:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec6e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038660 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.613419:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec6e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.613434:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.613446:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951637.613527:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1783951637.613530:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951637.613546:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.613567:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec6e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038660 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.613580:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038660 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.613586:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:2.0:1783951637.613588:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951637.613591:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f400, rc 0) 00000100:00100000:2.0:1783951637.613645:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:10282:x1870608602262784:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 366us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951637.613652:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:2.0:1783951637.617489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951637.617556:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602263040 00000100:00100000:0.0:1783951637.617569:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602263040 00000100:00100000:0.0:1783951637.617676:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:0.0:1783951637.617697:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:10282:x1870608602263040:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951637.617734:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951637.617758:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec6ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038667 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.617940:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec6f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.617969:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.617981:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951637.617994:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783951637.618199:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec6ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038667 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.618217:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038667 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.618226:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d44e70e00) 00010000:00010000:0.0:1783951637.618229:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951637.618232:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5600, rc 0) 00000100:00100000:0.0:1783951637.618357:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10282:x1870608602263040:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 671us (878us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783951637.618364:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:3.0:1783951637.621435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951637.621474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951637.621586:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602263296 00000100:00100000:2.0:1783951637.621595:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602263296 00000100:00100000:2.0:1783951637.621651:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1783951637.621661:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10282:x1870608602263296:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951637.621687:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951637.621718:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec703 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03866e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.621836:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec70a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.621863:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec70a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.622058:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec70a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951637.622128:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783951637.622278:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec703 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03866e expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.622297:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec70a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03866e expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.622306:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d44e70e00) 00010000:00010000:2.0:1783951637.622310:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783951637.622313:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:1.0:1783951637.622454:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602263424 00000100:00100000:1.0:1783951637.622459:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602263424 00000100:00100000:1.0:1783951637.622508:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1783951637.622516:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:2358:x1870608602263424:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951637.622526:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951637.622540:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec6f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038667 expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.622551:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d44e70e00) 00010000:00010000:1.0:1783951637.622554:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951637.622594:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10282:x1870608602263296:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 933us (1169us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783951637.622600:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1783951637.623297:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:2358:x1870608602263424:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 779us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951637.623306:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1783951637.629165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951637.629231:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602263552 00000100:00100000:0.0:1783951637.629243:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602263552 00000100:00100000:0.0:1783951637.629307:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1783951637.629318:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2361:x1870608602263552:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:0.0:1783951637.629365:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.629394:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.629416:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951637.629421:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951637.629425:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.629462:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.629475:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 7 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951637.629490:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1870608624316032:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951637.629586:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81563c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951637.633296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.633418:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602263680 00000100:00100000:1.0:1783951637.633429:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602263680 00002000:00100000:1.0:1783951637.633477:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8e8d75a5aa00 x1870608602263680/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:653/0 lens 504/0 e 0 to 0 dl 1783951648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951637.633488:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d75a5aa00 with x1870608602263680 ext(0->12) 00010000:00010000:1.0:1783951637.633499:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 8 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.633534:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 8 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951637.633542:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8d75a5aa00 00000100:00100000:1.0:1783951637.633579:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783951637.633588:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602263680:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:0.0:1783951637.634272:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1870608624316032:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951637.634301:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783951637.675532:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00010000:00010000:0.0:1783951637.749917:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951637.753630:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2359:x1870608602263680:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 120030us (120333us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783951637.753649:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00002000:00100000:3.0:1783951637.753662:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8e8d75a5aa00 x1870608602263680/t4294967299(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:653/0 lens 504/448 e 0 to 0 dl 1783951648 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951637.753672:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d75a5aa00 with x1870608602263680 ext(0->12) 00010000:00010000:3.0:1783951637.753684:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 9 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.753703:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 9 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951637.753711:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8d75a5aa00 00000001:00080000:2.0:1783951637.754375:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1783951637.757414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.758225:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602263808 00000100:00100000:1.0:1783951637.758237:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602263808 00010000:00010000:1.0:1783951637.758283:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 7 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951637.758334:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:1.0:1783951637.758345:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2360:x1870608602263808:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951637.758361:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783951637.758494:0:8312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783951637.758498:0:8312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783951637 00002000:00010000:1.0:1783951637.758500:0:8312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783951637 00002000:00010000:1.0:1783951637.758502:0:8312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783951637 00002000:00010000:1.0:1783951637.758504:0:8312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1783951637.758512:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 7 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.758529:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 7 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.758581:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ff5aeb8/0x443dabd358eec6cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038652 expref: 7 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.758599:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951637.758604:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951637.758610:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.758621:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.758660:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951637.758729:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602263808:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 385us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951637.758738:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00010000:00010000:3.0:1783951637.759802:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.759840:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.759895:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.759905:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.759913:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.759921:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951637.759926:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.759934:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.759954:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.759961:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eec718 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951637.760052:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602263552:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 130732us (130895us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951637.760070:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1783951637.766660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.766762:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602264064 00000100:00100000:1.0:1783951637.766772:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602264064 00000100:00100000:1.0:1783951637.766851:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1783951637.766864:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:10282:x1870608602264064:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:1.0:1783951637.766930:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec70a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03866e expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951637.767332:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1783951637.767411:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1783951637.768800:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1783951637.768905:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.768924:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.768946:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.768984:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.769000:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 24 pid: 5793 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951637.769016:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1870608624316160:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951637.769128:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81563c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951637.778028:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1870608624316160:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951637.778060:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951637.785715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951637.786071:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602264192 00000100:00100000:2.0:1783951637.786083:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602264192 00010000:00010000:2.0:1783951637.786143:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 25 pid: 5793 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951637.786187:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:2.0:1783951637.786198:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:2358:x1870608602264192:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951637.786226:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951637.786235:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 25 pid: 5793 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.786248:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 25 pid: 5793 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.786272:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec6af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038644 expref: 25 pid: 5793 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.786290:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d44e70e00) 00010000:00010000:2.0:1783951637.786295:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.786304:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.786311:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.786513:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951637.786579:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:2358:x1870608602264192:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 382us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951637.786587:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00010000:00010000:0.0:1783951637.787009:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951637.787019:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951637.790052:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783951637.790398:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1783951637.790536:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624316288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783951637.790618:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951637.790730:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951637.800158:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624316288 00000100:00100000:0.0:1783951637.800176:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624316288 00000100:00100000:0.0:1783951637.800269:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951637.800282:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1870608624316288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1783951637.800294:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951637.800457:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1870608624316288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 178us (9839us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951637.800479:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951637.802520:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624316288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783951637.803475:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1783951637.803603:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d75a58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624316416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783951637.803689:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951637.803722:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81592600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951637.805314:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624316416 00000100:00100000:1.0:1783951637.805326:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624316416 00000100:00100000:1.0:1783951637.805406:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951637.805417:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1870608624316416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783951637.805766:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1870608624316416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 350us (2076us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783951637.805774:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951637.809327:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d75a58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624316416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783951637.809451:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1783951637.809529:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.809541:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.809549:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.809555:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951637.809559:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.809568:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.809583:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d44e70e00) 00010000:00010000:3.0:1783951637.809586:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783951637.809591:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.809598:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec71f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951637.809921:0:5794:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783951637.810303:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1783951637.810322:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354715511320ns, next at 355715506891ns, rc = 0 00000001:00080000:3.0:1783951637.810333:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1783951637.810388:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d44e70e00) 00010000:00010000:3.0:1783951637.810391:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783951637.810400:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec70a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03866e expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951637.810549:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10282:x1870608602264064:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 43686us (44166us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1783951637.810560:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000020:00080000:3.0:1783951637.810567:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783951637.814593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.815332:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602264320 00000100:00100000:1.0:1783951637.815344:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602264320 00000100:00100000:3.0:1783951637.815449:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1783951637.815466:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10282:x1870608602264320:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951637.815492:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951637.815519:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec726 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038675 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.815596:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038675 expref: 28 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.815612:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038675 expref: 28 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951637.815634:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:3.0:1783951637.815665:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951637.815670:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8600, rc 0) 00000100:00100000:3.0:1783951637.816022:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:10282:x1870608602264320:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 560us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951637.816030:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:1.0:1783951637.827614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951637.827754:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602264576 00000100:00100000:3.0:1783951637.827764:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602264576 00000100:00100000:3.0:1783951637.827851:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1783951637.827862:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d518a9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:10282:x1870608602264576:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951637.828120:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d518a9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:10282:x1870608602264576:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 259us (517us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1783951637.828129:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1783951637.878056:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624316544:0@lo:400:kworker.0 00000100:00100000:3.0:1783951637.878135:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624316800:0@lo:400:kworker.0 00000100:00100000:1.0:1783951637.878137:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951637.878196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951637.878197:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951637.878203:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624316928:0@lo:400:kworker.0 00000100:00100000:3.0:1783951637.878236:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951637.878241:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624316672:0@lo:400:kworker.0 00000100:00100000:2.0:1783951637.878387:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624316800 00000100:00100000:2.0:1783951637.878395:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624316800 00000100:00100000:2.0:1783951637.878538:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783951637.878550:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624316800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951637.880526:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624316544 00000100:00100000:0.0:1783951637.880542:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624316544 00000100:00100000:0.0:1783951637.880617:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783951637.880629:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624316544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951637.882042:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951637.882105:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624317056:0@lo:400:kworker.0 00000100:00100000:1.0:1783951637.882144:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951637.883292:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624317056 00000100:00100000:1.0:1783951637.883300:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624317056 00000100:00100000:1.0:1783951637.883355:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783951637.883377:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624317056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951637.883437:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624317056:12345-0@lo:400:kworker.0 Request processed in 74us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951637.883445:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783951637.883490:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624317056:0@lo:400:kworker.0 00000100:00080000:1.0:1783951637.883540:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951637.883557:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624316928 00000100:00100000:1.0:1783951637.883560:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624316928 00000100:00100000:1.0:1783951637.883599:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783951637.883605:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624316928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951637.883643:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624316928:12345-0@lo:400:kworker.0 Request processed in 38us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951637.883649:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783951637.883676:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624316928:0@lo:400:kworker.0 00000100:00100000:1.0:1783951637.889121:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951637.890143:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624316672 00000100:00100000:3.0:1783951637.890155:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624316672 00000100:00100000:3.0:1783951637.891025:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783951637.891037:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624316672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951637.891129:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624316672:12345-0@lo:400:kworker.0 Request processed in 95us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951637.891136:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783951637.893049:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624316672:0@lo:400:kworker.0 00000100:00100000:2.0:1783951637.893934:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624316800:12345-0@lo:400:kworker.0 Request processed in 15382us (15736us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951637.893946:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783951637.894742:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624316544:12345-0@lo:400:kworker.0 Request processed in 14113us (16600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951637.894753:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1783951637.895312:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624316800:0@lo:400:kworker.0 00000100:00100000:2.0:1783951637.895413:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624316544:0@lo:400:kworker.0 00000100:00100000:2.0:1783951637.947329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.947464:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602264832 00000100:00100000:1.0:1783951637.947476:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602264832 00000100:00100000:1.0:1783951637.947543:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:1.0:1783951637.947553:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:10292:x1870608602264832:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951637.947585:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951637.947609:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec72d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03867c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951637.948055:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783951637.948276:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec72d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03867c expref: 31 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.948294:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:1.0:1783951637.948297:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951637.948301:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec72d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03867c expref: 31 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.948339:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5fc00, rc 0) 00000100:00100000:1.0:1783951637.948476:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+30:10292:x1870608602264832:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 923us (1155us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1783951637.948485:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1783951637.951985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.952088:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602264960 00000100:00100000:1.0:1783951637.952102:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602264960 00000100:00100000:1.0:1783951637.952275:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1783951637.952288:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+30:10292:x1870608602264960:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:1.0:1783951637.952381:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952398:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952410:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952428:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952435:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952441:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952569:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952601:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952608:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951637.952662:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952676:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952684:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952691:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952697:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5f200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951637.952701:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952721:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952735:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951637.952738:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951637.952743:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952748:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec73b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952772:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952954:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952962:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952968:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951637.952971:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952977:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952985:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951637.952988:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951637.952991:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.952996:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.953011:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.953017:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.953021:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.953033:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951637.953036:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.953042:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.953050:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951637.953052:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951637.953055:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.953060:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951637.953231:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+30:10292:x1870608602264960:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 944us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951637.953240:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:0.0:1783951637.955986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951637.956112:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602265216 00000100:00100000:3.0:1783951637.956123:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602265216 00000100:00100000:3.0:1783951637.956259:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1783951637.956270:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+30:10292:x1870608602265216:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951637.956581:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:10292:x1870608602265216:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 312us (604us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1783951637.956589:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1783951637.990154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951637.990539:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602265472 00000100:00100000:1.0:1783951637.990549:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602265472 00000100:00100000:1.0:1783951637.990673:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:1.0:1783951637.990685:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:10295:x1870608602265472:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951637.990726:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951637.990750:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec750 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.990965:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.990999:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991012:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991029:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991037:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991044:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991190:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991199:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991206:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951637.991216:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783951637.991319:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991328:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991335:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991347:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951637.991352:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991373:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991386:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951637.991389:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951637.991394:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991399:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec757 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991412:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991417:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991423:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991429:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5f200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951637.991432:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991437:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991455:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951637.991458:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951637.991461:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991466:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec75e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991512:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec750 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 34 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991525:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951637.991533:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951637.991535:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951637.991538:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5fc00, rc 0) 00000100:00100000:1.0:1783951637.991615:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:10295:x1870608602265472:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 932us (1469us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1783951637.991624:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:1.0:1783951637.994320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951637.994369:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602265600 00000100:00100000:2.0:1783951637.994378:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602265600 00000100:00100000:2.0:1783951637.994429:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1783951637.994441:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:10295:x1870608602265600:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1783951637.994510:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994526:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994535:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994562:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994566:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994571:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994590:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951637.994593:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994600:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994608:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951637.994610:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951637.994613:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951637.994617:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951637.994675:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:10295:x1870608602265600:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 236us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951637.994682:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1783951637.996736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951637.996842:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602265856 00000100:00100000:3.0:1783951637.996851:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602265856 00000100:00100000:3.0:1783951637.996913:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:3.0:1783951637.996923:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:10295:x1870608602265856:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951637.997158:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:10295:x1870608602265856:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 235us (432us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1783951637.997165:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:3.0:1783951638.251463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951638.251646:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602266112 00000100:00100000:0.0:1783951638.251656:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602266112 00000100:00100000:0.0:1783951638.251769:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1783951638.251780:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:10326:x1870608602266112:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1783951638.251806:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951638.251853:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eec77a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03868a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.251963:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.251980:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.251996:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951638.252032:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783951638.252487:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eec77a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03868a expref: 37 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.252507:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03868a expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.252515:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:0.0:1783951638.252518:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951638.252522:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4600, rc 0) 00000100:00100000:0.0:1783951638.252637:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:10326:x1870608602266112:12345-192.168.201.6@tcp:101:cat.0 Request processed in 858us (1184us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783951638.252645:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1783951638.258169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951638.258267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.258772:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602266496 00000100:00100000:1.0:1783951638.258783:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602266496 00000100:00100000:1.0:1783951638.258885:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1783951638.258895:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:2359:x1870608602266496:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951638.258914:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951638.258940:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03868a expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.258973:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951638.258979:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951638.259351:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:2359:x1870608602266496:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 455us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951638.259370:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1783951638.259590:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602266368 00000100:00100000:3.0:1783951638.259596:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602266368 00000100:00100000:3.0:1783951638.259636:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1783951638.259644:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:10326:x1870608602266368:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:3.0:1783951638.260010:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:10326:x1870608602266368:12345-192.168.201.6@tcp:35:cat.0 Request processed in 366us (1853us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1783951638.260018:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1783951638.327778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.327882:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602266752 00000100:00100000:1.0:1783951638.327891:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602266752 00000100:00100000:1.0:1783951638.327950:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:1.0:1783951638.327961:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:10332:x1870608602266752:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:1.0:1783951638.327992:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951638.327996:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783951638.328024:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec6e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038660 expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.328041:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951638.328046:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951638.328069:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec78f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038691 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.328183:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.328197:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 36 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.328206:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.328260:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 36 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.328273:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 36 pid: 5792 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951638.328288:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624317184:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951638.328418:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7592d000 going to sleep for 11 seconds 00000100:00100000:1.0:1783951638.331594:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624317184:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951638.331624:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951638.333330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.333460:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602266880 00000100:00100000:1.0:1783951638.333469:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602266880 00010000:00010000:1.0:1783951638.333518:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 37 pid: 5792 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951638.333568:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:1.0:1783951638.333576:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:2359:x1870608602266880:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951638.333591:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951638.333598:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 37 pid: 5792 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.333608:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 37 pid: 5792 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.333652:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038683 expref: 37 pid: 5792 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.333668:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951638.333671:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.333678:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.333684:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.333710:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951638.333760:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:2359:x1870608602266880:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 185us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951638.333765:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00010000:00010000:3.0:1783951638.333950:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.333960:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951638.333980:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783951638.334198:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec78f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 37 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.334216:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 36 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.334224:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:3.0:1783951638.334227:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951638.334229:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5f200, rc 0) 00000100:00100000:3.0:1783951638.334263:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:10332:x1870608602266752:12345-192.168.201.6@tcp:101:dd.0 Request processed in 6305us (6495us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783951638.334271:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:2.0:1783951638.337561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.337979:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602267136 00000100:00100000:1.0:1783951638.337992:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602267136 00000100:00100000:1.0:1783951638.338114:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:1.0:1783951638.338127:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:10332:x1870608602267136:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:1.0:1783951638.338472:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.338492:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.338505:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951638.338584:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1783951638.338614:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b27c329 reply state 000000008e3c2834 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951638.338623:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951638.339000:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:10332:x1870608602267136:12345-192.168.201.6@tcp:36:dd.0 Request processed in 873us (1448us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1783951638.339009:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000020:00080000:1.0:1783951638.339014:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783951638.340842:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.340866:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.340873:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.340879:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951638.340883:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.340890:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.340905:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:3.0:1783951638.340909:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951638.340927:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.340932:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec7a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951638.390094:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624317312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951638.390173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951638.391075:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624317312 00000100:00100000:2.0:1783951638.391085:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624317312 00000100:00100000:2.0:1783951638.391144:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951638.391155:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624317312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951638.391186:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1783951638.396586:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624317312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5421us (6401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951638.396616:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783951638.398924:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624317312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951638.509132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951638.509243:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602267264 00000100:00100000:0.0:1783951638.509254:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602267264 00000100:00100000:0.0:1783951638.509375:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:0.0:1783951638.509386:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+38:10346:x1870608602267264:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:0.0:1783951638.509413:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951638.509437:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec7ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038698 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509536:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509552:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509565:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509579:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509585:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509591:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509690:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509700:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 39 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509707:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509741:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 39 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.509764:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 39 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951638.509778:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624317440:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951638.509916:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81563780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951638.512751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951638.512844:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602267520 00000100:00100000:3.0:1783951638.512853:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602267520 00000100:00100000:0.0:1783951638.513004:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624317440:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951638.513032:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951638.513088:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1783951638.513098:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:5574:x1870608602267520:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783951638.513475:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+41:5574:x1870608602267520:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 377us (732us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1783951638.513482:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1783951638.516373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951638.516443:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602267648 00000100:00100000:0.0:1783951638.516451:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602267648 00010000:00010000:0.0:1783951638.516485:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 41 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951638.516525:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1783951638.516534:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+41:2358:x1870608602267648:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951638.516548:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951638.516555:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 41 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.516567:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 41 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.516589:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f200/0x443dabd358eec796 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038691 expref: 41 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.516620:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:0.0:1783951638.516624:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.516631:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.516637:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.516691:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951638.516744:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:2358:x1870608602267648:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 209us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951638.516751:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00010000:00010000:2.0:1783951638.517974:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.517988:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951638.518307:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783951638.518310:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951638.518409:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518425:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518434:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518439:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518444:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518447:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951638.518450:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518454:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518475:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:2.0:1783951638.518476:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951638.518480:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518484:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec7b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518496:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518502:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518507:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518512:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951638.518515:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518521:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518528:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d452ae500) 00010000:00010000:2.0:1783951638.518531:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951638.518534:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518540:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec7b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518590:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec7ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038698 expref: 40 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518604:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038698 expref: 39 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.518611:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951638.518613:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951638.518615:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4c00, rc 0) 00000100:00100000:2.0:1783951638.518724:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:10346:x1870608602267264:12345-192.168.201.6@tcp:101:stat.0 Request processed in 9339us (9600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951638.518732:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1783951638.576032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.577277:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602267904 00000100:00100000:1.0:1783951638.577290:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602267904 00000100:00100000:1.0:1783951638.577464:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1783951638.577476:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:10352:x1870608602267904:12345-192.168.201.6@tcp:36:truncate.0 00010000:00010000:1.0:1783951638.577538:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951638.577566:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec7c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038698 expref: 39 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.577584:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951638.577590:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951638.577882:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.577895:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.577905:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951638.577966:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1783951638.578019:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f14351e5 reply state 000000009736b71c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951638.578029:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951638.578575:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+41:10352:x1870608602267904:12345-192.168.201.6@tcp:36:truncate.0 Request processed in 1098us (2549us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1783951638.578582:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000020:00080000:1.0:1783951638.578587:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783951638.604961:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.604980:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.604997:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.605004:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5fc00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951638.605009:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.605017:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.605037:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951638.605405:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951638.605412:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.605419:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951638.719937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951638.720624:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602268032 00000100:00100000:3.0:1783951638.720638:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602268032 00000100:00100000:3.0:1783951638.720864:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:3.0:1783951638.720876:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:10366:x1870608602268032:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:3.0:1783951638.720907:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951638.720931:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec7ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03869f expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721016:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721032:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721053:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721082:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721088:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721092:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721190:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721195:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721200:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951638.721230:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1783951638.721233:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951638.721264:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721277:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721285:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721291:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721308:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721315:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951638.721319:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721326:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721335:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:3.0:1783951638.721338:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951638.721341:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721345:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec7d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721368:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721374:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721380:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721385:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951638.721388:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721403:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721412:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d821cf400) 00010000:00010000:3.0:1783951638.721414:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951638.721417:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721422:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec7dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721461:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec7ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 42 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721475:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 41 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.721482:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:3.0:1783951638.721484:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951638.721486:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:3.0:1783951638.721566:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+41:10366:x1870608602268032:12345-192.168.201.6@tcp:101:stat.0 Request processed in 692us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951638.721574:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00010000:00010000:0.0:1783951638.775786:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951638.823344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951638.823480:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602268288 00000100:00100000:3.0:1783951638.823491:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602268288 00000100:00100000:3.0:1783951638.823602:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:3.0:1783951638.823614:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+41:10376:x1870608602268288:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951638.823640:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951638.823677:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec7ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386a6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951638.823943:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783951638.824092:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec7ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386a6 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.824117:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:3.0:1783951638.824120:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951638.824125:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec7ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386a6 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.824141:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8400, rc 0) 00000100:00100000:3.0:1783951638.824207:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+42:10376:x1870608602268288:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 595us (873us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1783951638.824215:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:0.0:1783951638.829903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.830285:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602268544 00000100:00100000:1.0:1783951638.830305:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602268544 00000100:00100000:1.0:1783951638.830379:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:1.0:1783951638.830391:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+42:10376:x1870608602268544:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951638.830706:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:10376:x1870608602268544:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 318us (811us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1783951638.830715:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1783951638.866483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951638.866526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951638.866564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.866655:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602268672 00000100:00100000:1.0:1783951638.866666:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602268672 00000100:00100000:1.0:1783951638.866728:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 281 00000100:00100000:1.0:1783951638.866738:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602268672:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951638.866835:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602268672:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951638.866843:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 281 00000100:00100000:0.0:1783951638.867135:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602268928 00000100:00100000:0.0:1783951638.867140:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602268928 00000100:00100000:0.0:1783951638.867195:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:0.0:1783951638.867203:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602268928:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951638.867241:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602268928:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 39us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951638.867247:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00080000:1.0:1783951638.868146:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951638.868272:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602268800 00000100:00100000:3.0:1783951638.868279:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602268800 00000100:00100000:3.0:1783951638.868583:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:3.0:1783951638.868593:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602268800:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951638.868698:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602268800:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 106us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951638.868705:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:2.0:1783951638.911218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.911456:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602269184 00000100:00100000:1.0:1783951638.911467:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602269184 00000100:00100000:1.0:1783951638.911520:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1783951638.911532:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:10382:x1870608602269184:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951638.911559:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951638.911578:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386ad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.911673:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.911684:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 44 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.911706:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.911848:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 44 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.911861:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 44 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951638.911875:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624317568:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951638.911997:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951638.915106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951638.915148:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602269312 00000100:00100000:2.0:1783951638.915156:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602269312 00010000:00010000:2.0:1783951638.915193:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 45 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951638.915239:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1783951638.915250:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:2358:x1870608602269312:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951638.915277:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951638.915284:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 45 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.915296:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 45 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.915327:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951638.915333:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.915342:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.915360:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.915378:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951638.915424:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:2358:x1870608602269312:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 176us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951638.915431:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00010000:00010000:1.0:1783951638.916277:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec7e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03869f expref: 44 pid: 8068 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951638.916294:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624317568:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951638.916378:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.916387:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.916392:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951638.916411:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1783951638.916652:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec7f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 45 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.916685:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 44 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.916694:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951638.916697:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951638.916700:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5e000, rc 0) 00000100:00100000:1.0:1783951638.916941:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+44:10382:x1870608602269184:12345-192.168.201.6@tcp:101:bash.0 Request processed in 5410us (5730us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1783951638.916949:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:0.0:1783951638.919446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951638.919502:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602269568 00000100:00100000:3.0:1783951638.919512:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602269568 00000100:00100000:3.0:1783951638.919578:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:3.0:1783951638.919587:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+44:10382:x1870608602269568:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:3.0:1783951638.920464:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.920484:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951638.920498:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951638.920563:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1783951638.920591:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c872af9 reply state 0000000046dd4f30 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951638.920600:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951638.920699:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:10382:x1870608602269568:12345-192.168.201.6@tcp:36:bash.0 Request processed in 1111us (1257us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1783951638.920707:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000020:00080000:3.0:1783951638.920712:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783951638.927561:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.927595:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.927604:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.927612:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951638.927617:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.927623:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.927637:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:0.0:1783951638.927640:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951638.927643:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.927647:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec80d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951638.934578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951638.934619:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602269696 00000100:00100000:2.0:1783951638.934629:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602269696 00000100:00100000:2.0:1783951638.934681:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1783951638.934692:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+46:10382:x1870608602269696:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951638.934729:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951638.934753:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386b4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.934887:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.934904:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.934912:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.934948:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951638.934961:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 47 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951638.934976:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f727100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624317696:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951638.935063:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d50b39300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951638.939626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951638.939731:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f727100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624317696:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951638.939759:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951638.940093:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602269824 00000100:00100000:0.0:1783951638.940100:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602269824 00010000:00010000:0.0:1783951638.940138:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 48 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951638.940190:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:0.0:1783951638.940325:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+48:2359:x1870608602269824:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951638.940353:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951638.940375:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 48 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.940388:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 48 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.940413:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec7ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ad expref: 48 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.940430:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:0.0:1783951638.940436:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.940446:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.940453:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951638.940481:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951638.940534:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:2359:x1870608602269824:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 335us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951638.940542:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00010000:00010000:1.0:1783951638.941513:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.941524:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951638.941576:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783951638.941580:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951638.941600:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.941636:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386b4 expref: 47 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.941673:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386b4 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.941682:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951638.941684:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951638.941688:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:1.0:1783951638.941750:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+46:10382:x1870608602269696:12345-192.168.201.6@tcp:101:bash.0 Request processed in 7060us (7184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951638.941758:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:1.0:1783951638.947941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951638.948085:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602270080 00000100:00100000:3.0:1783951638.948096:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602270080 00000100:00100000:3.0:1783951638.948153:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783951638.948165:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d518a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+46:10382:x1870608602270080:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:3.0:1783951638.948632:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d518a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:10382:x1870608602270080:12345-192.168.201.6@tcp:35:bash.0 Request processed in 469us (702us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1783951638.948703:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000001:00080000:1.0:1783951638.965098:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967331 is committed 00000001:00080000:1.0:1783951638.965122:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000004:00080000:1.0:1783951638.965182:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1783951638.965208:0:5813:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8d81592540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1783951638.965213:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d75b69700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d81592000 00000020:00080000:1.0:1783951638.965216:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d75b69e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d75609800 00000020:00080000:1.0:1783951638.965236:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1783951638.965373:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783951638.965586:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951638.965607:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624317824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783951638.965673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951638.965803:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624317824 00000100:00100000:1.0:1783951638.965837:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624317824 00000100:00100000:1.0:1783951638.965880:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951638.965890:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624317824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783951638.965917:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1783951638.965949:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a54f115, atime: 0x6a54f115, ctime: 0x6a54f115, blocks: 0xb 00010000:00010000:1.0:1783951638.965956:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.965986:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1783951638.965990:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951638.965996:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966012:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966021:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966029:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966053:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783951638.966549:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1870608624317824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 659us (874us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783951638.966557:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783951638.966584:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951638.966592:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966600:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951638.966605:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966626:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966646:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966654:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000355be2ac/0x443dabd358eec822 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951638.966675:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951638.966677:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951638.966679:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783951638.966729:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d7f726300/2, rc 0, transno 4294967301 00000100:00100000:1.0:1783951638.966735:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624317824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783951639.057151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951639.057351:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602270336 00000100:00100000:0.0:1783951639.057361:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602270336 00000100:00100000:0.0:1783951639.057438:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:0.0:1783951639.057450:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:10392:x1870608602270336:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951639.057478:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951639.057500:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eec829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386bb expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951639.059230:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1783951639.059519:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eec829 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386bb expref: 17 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.059537:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:0.0:1783951639.059540:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951639.059545:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eec829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386bb expref: 17 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.059560:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4000, rc 0) 00000100:00100000:0.0:1783951639.059631:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:10392:x1870608602270336:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 2183us (2489us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1783951639.059640:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00080000:1.0:1783951639.060014:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951639.063286:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951639.063687:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602270464 00000100:00100000:2.0:1783951639.063699:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602270464 00000100:00100000:2.0:1783951639.063803:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:2.0:1783951639.063853:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:10392:x1870608602270464:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:2.0:1783951639.063934:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.063968:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.063989:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064007:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064014:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064021:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064580:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064592:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064600:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951639.064647:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064660:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064666:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064682:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064688:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951639.064692:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064700:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064713:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:2.0:1783951639.064716:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951639.064720:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064727:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec837 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064741:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064747:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064752:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064756:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fe00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951639.064759:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064774:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064782:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d44e70800) 00010000:00010000:2.0:1783951639.064784:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951639.064786:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064792:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec83e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064806:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064836:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064841:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064847:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951639.064850:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064856:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064862:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951639.064864:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951639.064867:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.064883:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec845 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951639.064980:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:10392:x1870608602270464:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1137us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951639.064989:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1783951639.067616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951639.067715:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602270720 00000100:00100000:0.0:1783951639.067724:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602270720 00000100:00100000:0.0:1783951639.067784:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:0.0:1783951639.067795:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:10392:x1870608602270720:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1783951639.068382:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:10392:x1870608602270720:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 586us (772us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783951639.068390:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1783951639.112644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951639.112762:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602270976 00000100:00100000:0.0:1783951639.112773:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602270976 00000100:00100000:0.0:1783951639.112879:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1783951639.112890:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:10395:x1870608602270976:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951639.112935:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951639.112957:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eec84c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113189:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113204:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113217:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113233:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113240:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113248:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113628:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113638:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113646:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951639.113657:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783951639.113766:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113774:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113780:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113786:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951639.113791:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113798:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.113839:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:0.0:1783951639.113969:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951639.113974:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.114101:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eec853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.114115:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.114121:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.114127:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.114132:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951639.114143:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.114149:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.114158:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d452ae200) 00010000:00010000:0.0:1783951639.114160:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951639.114163:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.114169:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec85a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.114355:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eec84c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386c2 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.114373:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386c2 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.114381:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951639.114384:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951639.114387:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5e00, rc 0) 00000100:00100000:1.0:1783951639.114461:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10395:x1870608602270976:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1572us (1827us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1783951639.114475:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1783951639.119257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951639.119330:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602271104 00000100:00100000:1.0:1783951639.119351:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602271104 00000100:00100000:1.0:1783951639.119414:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:1.0:1783951639.119427:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10395:x1870608602271104:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1783951639.119516:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119538:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119551:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119589:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119596:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119602:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119608:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951639.119612:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119619:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119631:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951639.119649:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951639.119655:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.119660:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec86f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951639.119742:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10395:x1870608602271104:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 317us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951639.119751:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:3.0:1783951639.122145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951639.122351:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602271232 00000100:00100000:2.0:1783951639.122360:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602271232 00000100:00100000:2.0:1783951639.122425:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1783951639.122434:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:2359:x1870608602271232:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951639.122451:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951639.122478:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386c2 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.122498:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951639.122503:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951639.122554:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:2359:x1870608602271232:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 122us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951639.122562:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:3.0:1783951639.125310:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951639.125721:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602271488 00000100:00100000:0.0:1783951639.125732:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602271488 00000100:00100000:0.0:1783951639.125800:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1783951639.125850:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:10395:x1870608602271488:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1783951639.126409:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10395:x1870608602271488:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 597us (1108us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783951639.126417:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1783951639.297454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951639.297570:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602271744 00000100:00100000:2.0:1783951639.297579:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602271744 00000100:00100000:2.0:1783951639.297698:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:2.0:1783951639.297723:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10413:x1870608602271744:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:2.0:1783951639.297751:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951639.297773:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386c9 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.297943:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec87d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.297959:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec87d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.297971:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec87d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951639.298324:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783951639.298485:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386c9 expref: 22 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.298505:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec87d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386c9 expref: 21 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.298514:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951639.298516:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783951639.298520:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fe00, rc 0) 00000100:00100000:2.0:1783951639.298664:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10413:x1870608602271744:12345-192.168.201.6@tcp:101:cat.0 Request processed in 956us (1219us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1783951639.298673:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:3.0:1783951639.342192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951639.342386:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602271872 00000100:00100000:1.0:1783951639.342397:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602271872 00000100:00100000:1.0:1783951639.342461:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:1.0:1783951639.342473:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10414:x1870608602271872:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951639.342507:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951639.342530:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec88b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386d0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.342634:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.342651:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.342663:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951639.343723:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783951639.343731:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951639.343977:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.344028:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec88b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d0 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.344114:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d0 expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.344123:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951639.344126:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951639.344129:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5fc00, rc 0) 00000100:00100000:1.0:1783951639.344199:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10414:x1870608602271872:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1727us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951639.344285:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:3.0:1783951639.349544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951639.349739:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602272256 00000100:00100000:0.0:1783951639.349750:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602272256 00000100:00100000:3.0:1783951639.350146:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1783951639.350161:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10414:x1870608602272256:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951639.350572:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10414:x1870608602272256:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 414us (1040us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1783951639.350581:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:0.0:1783951639.355162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951639.355262:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602272384 00000100:00100000:1.0:1783951639.355274:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602272384 00000100:00100000:1.0:1783951639.355357:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1783951639.355369:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10414:x1870608602272384:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:1.0:1783951639.355388:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783951639.355416:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec81b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386b4 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.355439:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec87d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386c9 expref: 22 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.355451:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec726 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038675 expref: 21 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.355487:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:1.0:1783951639.355503:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951639.355594:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:10414:x1870608602272384:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 226us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951639.355603:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1783951639.360671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951639.361612:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602272512 00000100:00100000:1.0:1783951639.361626:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602272512 00000100:00100000:1.0:1783951639.361696:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:1.0:1783951639.361719:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:10414:x1870608602272512:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:1.0:1783951639.361879:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.361897:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951639.361909:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951639.362564:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951639.362777:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1783951639.362884:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1783951639.362995:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:10414:x1870608602272512:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 1286us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951639.363004:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:3.0:1783951639.389458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951639.389648:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602272640 00000100:00100000:2.0:1783951639.389659:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602272640 00000100:00100000:2.0:1783951639.389739:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:2.0:1783951639.389752:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:10416:x1870608602272640:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951639.389801:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951639.389880:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec8a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386d7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.389961:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.389977:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.389988:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390003:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390009:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390016:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390563:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390573:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390580:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951639.390623:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783951639.390633:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951639.390657:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390669:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390678:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390685:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390691:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390698:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fe00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951639.390703:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390711:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390722:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:2.0:1783951639.390725:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951639.390729:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390735:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec8a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390747:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390765:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390771:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390776:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951639.390779:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390785:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390793:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d44e70800) 00010000:00010000:2.0:1783951639.390795:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951639.390798:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.390804:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eec8ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.391109:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eec8a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.391125:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.391133:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:2.0:1783951639.391136:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951639.391145:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165ec00, rc 0) 00000100:00100000:2.0:1783951639.391375:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10416:x1870608602272640:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1623us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951639.391383:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00010000:00010000:2.0:1783951639.798004:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951639.930152:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951639.930162:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951639.930227:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783951639.930236:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783951639.930387:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d75a59880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624317952:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783951639.930525:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951639.941461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951639.941690:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602272768 00000100:00100000:1.0:1783951639.941700:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602272768 00000100:00100000:1.0:1783951639.941769:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:1.0:1783951639.941780:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10427:x1870608602272768:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783951639.941957:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10427:x1870608602272768:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 Request processed in 178us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951639.941966:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1783951639.943766:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d75a59880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624317952:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783951639.945220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951639.945464:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602272896 00000100:00100000:1.0:1783951639.945475:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602272896 00000100:00100000:1.0:1783951639.945667:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:1.0:1783951639.945678:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10427:x1870608602272896:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783951639.945724:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783951639.945853:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10427:x1870608602272896:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 177us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951639.945861:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:1.0:1783951639.951690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951639.951851:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602273024 00000100:00100000:3.0:1783951639.951862:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602273024 00000100:00100000:3.0:1783951639.951928:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:3.0:1783951639.951940:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10427:x1870608602273024:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783951639.952029:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952047:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952060:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952094:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952101:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952108:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952134:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952143:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952149:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951639.952200:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783951639.952205:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951639.952218:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952230:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952237:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952244:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952262:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951639.952267:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952275:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952289:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:3.0:1783951639.952292:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951639.952297:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952304:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec8bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952317:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952322:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952340:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952346:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951639.952349:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952355:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952373:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951639.952376:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951639.952379:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952385:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec8c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952400:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952406:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952412:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952417:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951639.952420:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952426:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952433:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:3.0:1783951639.952436:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951639.952438:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951639.952444:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec8ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951639.952541:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10427:x1870608602273024:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 603us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951639.952550:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:0.0:1783951639.965834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951639.967026:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602273280 00000100:00100000:2.0:1783951639.967041:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602273280 00000100:00100000:2.0:1783951639.967132:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:2.0:1783951639.967145:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10427:x1870608602273280:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951639.967170:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951639.967198:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec8d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386de expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967310:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967324:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967350:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951639.967361:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783951639.967464:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967472:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967478:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967496:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951639.967501:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967509:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967522:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:2.0:1783951639.967525:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951639.967530:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967536:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eec8d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967590:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec8d1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386de expref: 23 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967602:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:2.0:1783951639.967604:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951639.967608:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eec8d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386de expref: 23 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951639.967619:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f400, rc 0) 00000100:00100000:2.0:1783951639.967692:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10427:x1870608602273280:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 550us (1885us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1783951639.967699:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:3.0:1783951639.979971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951639.980686:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602273408 00000100:00100000:0.0:1783951639.980698:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602273408 00000100:00100000:0.0:1783951639.980769:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:0.0:1783951639.980780:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10427:x1870608602273408:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783951639.980851:0:5791:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783951639.980980:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10427:x1870608602273408:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 201us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951639.980988:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:3.0:1783951639.986251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951639.986466:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602273664 00000100:00100000:0.0:1783951639.986478:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602273664 00000100:00100000:0.0:1783951639.986542:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:0.0:1783951639.986553:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10427:x1870608602273664:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951639.986575:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951639.986579:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783951639.986607:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d0 expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.986628:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:0.0:1783951639.986633:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951639.986648:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec8e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386e5 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951639.987440:0:8068:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1783951639.987756:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec8ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.987772:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec8ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.987793:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec8ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.987886:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec8e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386e5 expref: 24 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.987902:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec8ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386e5 expref: 23 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.987911:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae200) 00010000:00010000:0.0:1783951639.987914:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951639.987917:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4c00, rc 0) 00000100:00100000:0.0:1783951639.987984:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10427:x1870608602273664:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1432us (1744us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1783951639.987992:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:0.0:1783951639.994765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951639.994804:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602273920 00000100:00100000:0.0:1783951639.994826:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602273920 00000100:00100000:0.0:1783951639.994960:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:0.0:1783951639.994971:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10427:x1870608602273920:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951639.995099:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951639.995128:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eec8ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386e5 expref: 23 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.995147:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae200) 00010000:00010000:0.0:1783951639.995159:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951639.995195:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.995210:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.995221:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.995276:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.995285:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.995293:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996255:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996266:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996274:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996281:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951639.996285:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996293:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996318:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:0.0:1783951639.996321:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951639.996345:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996351:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec8fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996361:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996368:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996374:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996379:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951639.996382:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996388:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996396:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xfde06e28 (ffff8e8d452ae600) 00010000:00010000:0.0:1783951639.996399:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951639.996402:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951639.996408:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec902 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfde06e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951639.996516:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10427:x1870608602273920:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1544us (1758us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951639.996525:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:2.0:1783951640.008782:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951640.011722:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602274048 00000100:00100000:0.0:1783951640.011738:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602274048 00000100:00100000:0.0:1783951640.012766:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1783951640.012780:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10427:x1870608602274048:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951640.012804:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951640.012859:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec909 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386ec expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.012911:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.012926:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.012939:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.013208:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 24 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.013227:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 23 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.013235:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:0.0:1783951640.013244:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951640.013248:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5600, rc 0) 00000100:00100000:0.0:1783951640.013321:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10427:x1870608602274048:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 544us (4547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951640.013340:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:3.0:1783951640.017437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.017483:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602274304 00000100:00100000:3.0:1783951640.017495:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602274304 00000100:00100000:3.0:1783951640.017555:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:3.0:1783951640.017566:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10427:x1870608602274304:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951640.018301:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.018324:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.018351:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951640.018980:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1783951640.018993:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356924182505ns, next at 357924179773ns, rc = 0 00000004:00010000:3.0:1783951640.019098:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db193761 reply state 0000000008c94c2d transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.019109:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951640.019243:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:10427:x1870608602274304:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1674us (1814us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1783951640.019252:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00010000:00010000:2.0:1783951640.029357:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.029374:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.029383:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.029390:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951640.029396:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.029404:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.029424:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:2.0:1783951640.029428:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783951640.029434:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.029441:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eec917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951640.029707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951640.030278:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602274432 00000100:00100000:2.0:1783951640.030289:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602274432 00000100:00100000:2.0:1783951640.030360:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:2.0:1783951640.030371:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:10427:x1870608602274432:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951640.030396:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951640.030415:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386f3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.030507:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.030522:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.030544:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:2.0:1783951640.030547:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951640.030550:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fe00, rc 0) 00000100:00100000:2.0:1783951640.031468:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:10427:x1870608602274432:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1090us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951640.031478:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:2.0:1783951640.036078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.036529:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602274560 00000100:00100000:3.0:1783951640.036540:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602274560 00000100:00100000:3.0:1783951640.036688:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1783951640.036697:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1870608602274560:12345-192.168.201.6@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1783951640.036731:0:8067:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:3.0:1783951640.036765:0:8067:0:(genops.c:1406:class_connect()) connect: client 65c652b5-a392-4c36-a8f6-f2bd53c90279, cookie 0x443dabd358eec925 00002000:00100000:3.0:1783951640.036778:0:8067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 65c652b5-a392-4c36-a8f6-f2bd53c90279/ffff8e8d452ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783951640.036827:0:8067:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783951640.037149:0:8067:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783951640.037190:0:8067:0:(import.c:65:import_set_state_nolock()) ffff8e8d452eb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951640.037279:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2357:x1870608602274560:12345-192.168.201.6@tcp:8:lhsmtool_posix.0 Request processed in 581us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951640.037287:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1783951640.050087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951640.050245:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602274688 00000100:00100000:1.0:1783951640.050258:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602274688 00000100:00100000:1.0:1783951640.050345:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1783951640.050357:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:0:x1870608602274688:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783951640.050702:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951640.129871:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:0:x1870608602274688:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 79506us (79787us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783951640.129886:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000001:00080000:1.0:1783951640.129925:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1783951640.129937:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000100:00100000:0.0:1783951640.133206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.133313:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602274944 00000100:00100000:3.0:1783951640.133333:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602274944 00000100:00100000:3.0:1783951640.133432:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1783951640.133444:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:10427:x1870608602274944:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783951640.133699:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:10427:x1870608602274944:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 256us (498us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1783951640.133707:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1783951640.138023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.138121:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602275200 00000100:00100000:3.0:1783951640.138140:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602275200 00000100:00100000:3.0:1783951640.138239:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:3.0:1783951640.138250:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:10427:x1870608602275200:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783951640.138393:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:10427:x1870608602275200:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 144us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951640.138402:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:2.0:1783951640.144265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.144343:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602275328 00000100:00100000:3.0:1783951640.144353:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602275328 00000100:00100000:3.0:1783951640.144412:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:3.0:1783951640.144424:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:10427:x1870608602275328:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951640.144446:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951640.144472:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec92c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0386fa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.144543:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.144559:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.144571:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951640.144611:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951640.144629:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.144666:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec92c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386fa expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.144684:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386fa expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.144720:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:3.0:1783951640.145350:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783951640.145356:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8000, rc 0) 00000100:00100000:3.0:1783951640.145420:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10427:x1870608602275328:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 998us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951640.145429:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:1.0:1783951640.152959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951640.153029:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602275456 00000100:00100000:2.0:1783951640.153040:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602275456 00000100:00100000:2.0:1783951640.153095:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1783951640.153104:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602275456:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951640.153221:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951640.153242:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038701 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951640.153270:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54f118, blocks: 0x1 00010000:00010000:2.0:1783951640.153288:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1783951640.153292:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951640.153314:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.153344:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.153358:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:2.0:1783951640.153416:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602275456:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 313us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951640.153424:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:1.0:1783951640.157713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951640.160179:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602275712 00000100:00100000:0.0:1783951640.160192:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602275712 00000100:00100000:1.0:1783951640.162035:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:1.0:1783951640.162064:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10427:x1870608602275712:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783951640.162209:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10427:x1870608602275712:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 149us (4504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951640.162218:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:0.0:1783951640.168893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951640.169241:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602275840 00000100:00100000:2.0:1783951640.169253:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602275840 00000100:00100000:2.0:1783951640.169319:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:2.0:1783951640.169344:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:10427:x1870608602275840:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951640.169362:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951640.169381:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038708 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.169418:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.169429:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951640.169434:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951640.169440:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.169476:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.169507:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 7 pid: 6589 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951640.169523:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624318080:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951640.169704:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d4480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951640.174258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951640.174393:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624318080:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951640.174429:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.174454:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:3.0:1783951640.174561:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602275968 00000100:00100000:3.0:1783951640.174570:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602275968 00010000:00010000:3.0:1783951640.174623:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 8 pid: 6589 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.174661:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:3.0:1783951640.174670:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602275968:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951640.174684:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951640.174710:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 8 pid: 6589 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.174722:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 8 pid: 6589 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.174753:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eec93a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038701 expref: 8 pid: 6589 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.174772:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951640.174796:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951640.174805:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.174866:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.174903:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.174916:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5777:1870608624318208:192.168.201.6@tcp:105: 00000100:00100000:1.0:1783951640.179499:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:10427:x1870608602275840:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 10143us (10598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951640.179514:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:3.0:1783951640.181848:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951640.182856:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5777:1870608624318208:192.168.201.6@tcp:105: 00010000:00010000:3.0:1783951640.182882:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951640.182928:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602275968:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 8258us (8679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951640.182940:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1783951640.184465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.185276:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602276096 00000100:00100000:3.0:1783951640.185286:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602276096 00002000:00100000:3.0:1783951640.185343:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e8d65ccf100 x1870608602276096/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:656/0 lens 504/0 e 0 to 0 dl 1783951651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951640.185354:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d65ccf100 with x1870608602276096 ext(0->8) 00002000:00010000:3.0:1783951640.185359:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d65ccf100 00000100:00100000:3.0:1783951640.185392:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1783951640.185402:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602276096:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783951640.188040:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602276096:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 2632us (3574us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783951640.188054:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00002000:00100000:3.0:1783951640.188065:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e8d65ccf100 x1870608602276096/t4294967302(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:656/0 lens 504/448 e 0 to 0 dl 1783951651 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951640.188076:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d65ccf100 with x1870608602276096 ext(0->8) 00002000:00010000:3.0:1783951640.188081:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d65ccf100 00000100:00100000:0.0:1783951640.199785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951640.199862:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602276224 00000100:00100000:0.0:1783951640.199872:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602276224 00000100:00100000:0.0:1783951640.199935:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:0.0:1783951640.199945:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10427:x1870608602276224:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783951640.293367:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:1.0:1783951640.293399:0:5813:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1783951640.293425:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1783951640.293433:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1783951640.293451:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1783951640.293464:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783951640.293593:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951640.293614:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624318336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783951640.293666:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:10427:x1870608602276224:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 93719us (93891us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951640.293670:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951640.293678:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:3.0:1783951640.293726:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624318336 00000100:00100000:3.0:1783951640.293735:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624318336 00000100:00100000:3.0:1783951640.293793:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783951640.293802:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624318336:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1783951640.293967:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1783951640.293978:0:8067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783951640.293982:0:8067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783951640 00002000:00010000:3.0:1783951640.293984:0:8067:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783951640.293986:0:8067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783951640 -> 1783951640 00002000:00010000:3.0:1783951640.293989:0:8067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783951640.294027:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624318336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (356us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783951640.294034:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1783951640.295210:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d81338a80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1783951640.295221:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624318336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783951640.298001:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951640.298102:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602276352 00000100:00100000:0.0:1783951640.298112:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602276352 00000100:00100000:0.0:1783951640.298166:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:0.0:1783951640.298176:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602276352:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783951640.333753:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602276352:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 35562us (35743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951640.333781:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000001:00080000:0.0:1783951640.333849:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1783951640.333860:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1783951640.338038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.338087:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602276608 00000100:00100000:3.0:1783951640.338108:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602276608 00000100:00100000:3.0:1783951640.338181:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:3.0:1783951640.338191:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:10427:x1870608602276608:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951640.338248:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951640.338275:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386fa expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.338290:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:3.0:1783951640.338295:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951640.338337:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.338352:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.338365:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951640.338646:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003cd19a42 reply state 000000001ef31f71 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.338656:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951640.338917:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:10427:x1870608602276608:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 726us (890us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1783951640.338926:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00010000:00010000:0.0:1783951640.344109:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.344131:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.344139:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.344147:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951640.344153:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.344160:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.344179:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:0.0:1783951640.344182:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951640.344187:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.344194:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eec948 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951640.344278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951640.344675:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602276736 00000100:00100000:0.0:1783951640.344685:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602276736 00000100:00100000:0.0:1783951640.344741:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1783951640.344752:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602276736:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783951640.345994:0:8067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783951640.346003:0:8067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783951640 -> 1783951639 00002000:00010000:0.0:1783951640.346006:0:8067:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783951637 00002000:00010000:0.0:1783951640.346009:0:8067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783951640 -> 1783951639 00002000:00010000:0.0:1783951640.346012:0:8067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783951640.346097:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602276736:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 1344us (1820us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783951640.346109:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1783951640.350693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.351272:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602276992 00000100:00100000:3.0:1783951640.351279:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602276992 00000100:00100000:3.0:1783951640.351340:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:3.0:1783951640.351351:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:10427:x1870608602276992:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783951640.351427:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.351440:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 13 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.351447:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.351474:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 13 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.351483:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 13 pid: 8068 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.351494:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624318464:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951640.351574:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d604e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951640.354722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.354779:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624318464:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951640.354831:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951640.354985:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602277120 00000100:00100000:1.0:1783951640.354993:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602277120 00010000:00010000:1.0:1783951640.355042:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 14 pid: 8068 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951640.355083:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:1.0:1783951640.355094:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:2359:x1870608602277120:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951640.355112:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951640.355135:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 14 pid: 8068 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.355147:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 14 pid: 8068 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.355174:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eec910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386ec expref: 14 pid: 8068 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.355190:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:1.0:1783951640.355195:0:8312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.355205:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.355212:0:8312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.355239:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951640.355292:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:2359:x1870608602277120:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 200us (580us total) trans 0 rc 0/0 00000040:00080000:2.0:1783951640.355297:0:11867:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:1.0:1783951640.355299:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000040:00080000:2.0:1783951640.355301:0:11867:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951640.355680:0:11867:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783951640.355686:0:11867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783951640.355719:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.355727:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.355766:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.355786:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.355792:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.355798:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951640.355803:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.356567:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.356587:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:3.0:1783951640.356590:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783951640.356595:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.356602:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eec94f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.356682:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+12:10427:x1870608602276992:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 5331us (5995us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783951640.356692:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:0.0:1783951640.368926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.372470:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602277248 00000100:00100000:3.0:1783951640.372485:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602277248 00000100:00100000:3.0:1783951640.372562:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1783951640.372573:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602277248:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783951640.372626:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.372663:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.372673:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951640.372677:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951640.372681:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.372730:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.372744:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 7 pid: 6590 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.372758:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624318592:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951640.372857:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d604e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951640.399169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.401691:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624318592:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951640.401733:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.401769:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602277376 00000100:00100000:3.0:1783951640.401776:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602277376 00010000:00010000:3.0:1783951640.401863:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 8 pid: 6590 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.401915:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:3.0:1783951640.401925:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602277376:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951640.401943:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951640.401971:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 8 pid: 6590 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.401984:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 8 pid: 6590 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.402008:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000febd1b6e/0x443dabd358eec941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038708 expref: 8 pid: 6590 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.402023:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951640.402028:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951640.402034:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.402043:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.402070:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951640.402138:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602277376:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 215us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951640.402145:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00010000:00010000:1.0:1783951640.402621:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.402629:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.402663:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.402669:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.402674:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.402679:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951640.402682:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.402688:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.402697:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.402701:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2e61242/0x443dabd358eec956 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951640.402766:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602277248:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 30193us (33851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951640.402774:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1783951640.410371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951640.411411:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602277632 00000100:00100000:0.0:1783951640.411424:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602277632 00000100:00100000:0.0:1783951640.411500:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:0.0:1783951640.411511:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+12:10427:x1870608602277632:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783951640.411619:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.411639:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.411652:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.411927:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.411940:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.411955:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.411993:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.412009:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 13 pid: 5793 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951640.412037:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ccea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624318720:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951640.412134:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81563300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951640.415517:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ccea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624318720:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951640.415557:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.415718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951640.415789:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602277760 00000100:00100000:2.0:1783951640.415799:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602277760 00010000:00010000:2.0:1783951640.415858:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 14 pid: 5793 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951640.416181:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:2.0:1783951640.416191:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:2358:x1870608602277760:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951640.416209:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951640.416217:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 14 pid: 5793 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.416228:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 14 pid: 5793 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.416249:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eec91e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386f3 expref: 14 pid: 5793 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.416268:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:2.0:1783951640.416272:0:8312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.416279:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.416284:0:8312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.416304:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951640.416340:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.416348:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951640.416372:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:2358:x1870608602277760:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 183us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951640.416379:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000001:00080000:0.0:1783951640.416568:0:8068:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1783951640.417259:0:8068:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1783951640.417310:0:8068:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1783951640.417414:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ccea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8068:1870608624318848:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783951640.417488:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951640.417526:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d81563000 going to sleep for 11 seconds 00000100:00100000:1.0:1783951640.417637:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624318848 00000100:00100000:1.0:1783951640.417643:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624318848 00000100:00100000:1.0:1783951640.417696:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951640.417705:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8068:x1870608624318848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783951640.417790:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8068:x1870608624318848:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951640.417797:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951640.417949:0:8068:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1783951640.417955:0:8068:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d81338a80, transno 4294967303 00000100:00100000:3.0:1783951640.417980:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ccea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8068:1870608624318848:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783951640.418772:0:8068:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1783951640.419035:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8068:1870608624318976:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783951640.419081:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951640.419158:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d551460c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951640.419643:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624318976 00000100:00100000:1.0:1783951640.419651:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624318976 00000100:00100000:1.0:1783951640.419691:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951640.419699:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8068:x1870608624318976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783951640.420267:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8068:1870608624318976:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783951640.420310:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420330:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420339:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420346:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951640.420351:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420360:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420389:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:3.0:1783951640.420392:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951640.420399:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420407:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eec964 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420451:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420458:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420464:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420469:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951640.420472:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420478:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420486:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:3.0:1783951640.420489:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951640.420492:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420497:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec899 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420529:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420545:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420554:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951640.420660:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8068:x1870608624318976:12345-0@lo:1000:mdt00_003.0 Request processed in 959us (1576us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783951640.420668:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783951640.420776:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.420793:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 16 pid: 5791 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951640.420806:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624319104:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951640.421087:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d551460c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951640.426872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951640.426980:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602277888 00000100:00100000:2.0:1783951640.426991:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602277888 00000100:00100000:1.0:1783951640.427034:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624319104:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951640.427067:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.427094:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 17 pid: 5791 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951640.427139:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:2.0:1783951640.427150:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:2359:x1870608602277888:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951640.427167:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951640.427175:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 17 pid: 5791 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.427187:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 17 pid: 5791 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.427222:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eec8b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0386d7 expref: 17 pid: 5791 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.427239:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:2.0:1783951640.427245:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.427255:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.427263:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951640.427289:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951640.427348:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:2359:x1870608602277888:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 200us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951640.427355:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00010000:00010000:1.0:1783951640.428060:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428070:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428084:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428091:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428112:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428129:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951640.428133:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428140:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428151:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:1.0:1783951640.428154:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951640.428158:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428164:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eec96b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428178:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428184:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428190:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428194:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951640.428197:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428213:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428221:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:1.0:1783951640.428223:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951640.428226:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951640.428232:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec95d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951640.428459:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:10427:x1870608602277632:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 16947us (18095us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1783951640.428468:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000020:00080000:1.0:1783951640.428472:0:8068:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783951640.428535:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951640.428540:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951640.428566:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783951640.428572:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951640.430516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951640.431665:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602278144 00000100:00100000:3.0:1783951640.431675:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602278144 00000100:00100000:3.0:1783951640.431877:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1783951640.431889:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:10427:x1870608602278144:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783951640.433186:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783951640.433339:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1783951640.433408:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.433431:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.433454:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.433465:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.433472:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.433478:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951640.433518:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951640.433668:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:10427:x1870608602278144:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1777us (3154us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1783951640.433680:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000020:00080000:3.0:1783951640.433687:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783951640.433856:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951640.433974:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.433984:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951640.433995:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.434004:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.434030:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:0.0:1783951640.434033:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783951640.434040:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.434047:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eec972 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951640.434067:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951640.434069:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951640.434071:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951640.822184:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951641.464580:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951641.464592:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951641.464625:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783951641.464631:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783951641.850002:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951641.974739:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951641.974764:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624319232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951641.975106:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951641.975176:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624319232 00000100:00100000:1.0:1783951641.975183:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624319232 00000100:00100000:1.0:1783951641.975231:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783951641.975240:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624319232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951641.975278:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951641.975330:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624319232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951641.975338:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783951641.975389:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624319232:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1783951642.307772:0:11919:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951642.307783:0:11919:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951642.308115:0:11919:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783951642.308121:0:11919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951642.428856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951642.428965:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602278400 00000100:00100000:1.0:1783951642.428973:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602278400 00000100:00100000:1.0:1783951642.429268:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:1.0:1783951642.429279:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:10446:x1870608602278400:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951642.429311:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951642.429334:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03870f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951642.429693:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783951642.429727:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec980 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.429741:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.429753:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951642.429764:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1783951642.430166:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03870f expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.430187:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03870f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.430196:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951642.430199:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951642.430202:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5e400, rc 0) 00000100:00100000:1.0:1783951642.431070:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10446:x1870608602278400:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1790us (2258us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1783951642.431091:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:1.0:1783951642.443571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951642.443847:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602278528 00000100:00100000:0.0:1783951642.443859:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602278528 00000100:00100000:0.0:1783951642.443915:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:0.0:1783951642.443925:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10446:x1870608602278528:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1783951642.444032:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444050:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444063:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444093:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444101:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444109:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444424:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444434:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444441:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951642.444483:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444494:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444498:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444503:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444507:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951642.444510:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444521:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444530:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:0.0:1783951642.444533:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951642.444537:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444541:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec98e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444551:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444554:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444558:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444560:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951642.444562:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444565:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444568:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d452ae600) 00010000:00010000:0.0:1783951642.444570:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951642.444571:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444581:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444614:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444620:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444626:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444631:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951642.444634:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444640:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444647:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951642.444649:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951642.444651:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.444655:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec99c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951642.444737:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10446:x1870608602278528:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 812us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951642.444743:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:3.0:1783951642.502738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951642.503154:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602278784 00000100:00100000:0.0:1783951642.503165:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602278784 00000100:00100000:0.0:1783951642.503234:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:0.0:1783951642.503244:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10449:x1870608602278784:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951642.503267:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951642.503300:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec9a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038716 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503375:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503390:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503416:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503432:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503458:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503465:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503893:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503918:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.503948:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951642.503984:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783951642.504145:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504153:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504171:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504177:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951642.504182:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504190:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504217:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:0.0:1783951642.504221:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951642.504226:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504232:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eec9aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504242:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504248:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504260:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504265:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951642.504268:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504274:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504281:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d452ae900) 00010000:00010000:0.0:1783951642.504292:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951642.504295:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504301:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504343:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec9a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504358:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.504366:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:0.0:1783951642.504368:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951642.504370:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5e00, rc 0) 00000100:00100000:0.0:1783951642.504448:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10449:x1870608602278784:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1204us (1719us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1783951642.504466:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:0.0:1783951642.515065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951642.516495:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602278912 00000100:00100000:3.0:1783951642.516508:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602278912 00000100:00100000:3.0:1783951642.516563:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:3.0:1783951642.516571:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10449:x1870608602278912:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1783951642.516659:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.516696:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.516708:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.516743:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.516747:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.516752:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.516757:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951642.516760:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.516765:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.517338:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:3.0:1783951642.517340:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951642.517344:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.517348:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eec9c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951642.517420:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10449:x1870608602278912:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 848us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951642.517433:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:2.0:1783951642.521514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951642.521618:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602279168 00000100:00100000:0.0:1783951642.521629:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602279168 00000100:00100000:0.0:1783951642.521692:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783951642.521702:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d518a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10449:x1870608602279168:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1783951642.522150:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d518a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10449:x1870608602279168:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 449us (643us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1783951642.522156:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:2.0:1783951642.620211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951642.620422:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602279424 00000100:00100000:0.0:1783951642.620436:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602279424 00000100:00100000:0.0:1783951642.620509:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:0.0:1783951642.620521:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:9968:x1870608602279424:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1783951642.620548:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951642.620566:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec9cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03871d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.620677:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.620692:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.620701:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.620737:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.620754:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 23 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951642.620766:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624319360:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951642.621313:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951642.628651:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624319360:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951642.628768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:0.0:1783951642.628788:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951642.632945:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602279552 00000100:00100000:1.0:1783951642.632963:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602279552 00010000:00010000:1.0:1783951642.633143:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 24 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951642.633468:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1783951642.633481:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:2358:x1870608602279552:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951642.633501:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951642.633509:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 24 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.633522:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 24 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.633545:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eec9b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038716 expref: 24 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.633563:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:1.0:1783951642.633569:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.633580:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.633588:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.633640:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951642.633710:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:2358:x1870608602279552:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 232us (4943us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951642.633718:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00010000:00010000:0.0:1783951642.634747:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.634757:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951642.634776:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783951642.634990:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eec9cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.635016:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951642.635024:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:0.0:1783951642.635027:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783951642.635031:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5c00, rc 0) 00000100:00100000:0.0:1783951642.635093:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:9968:x1870608602279424:12345-192.168.201.6@tcp:101:bash.0 Request processed in 14575us (14891us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1783951642.635114:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:2.0:1783951642.655460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951642.655567:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602279808 00000100:00100000:3.0:1783951642.655577:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602279808 00000100:00100000:3.0:1783951642.655646:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:3.0:1783951642.655657:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:9968:x1870608602279808:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:3.0:1783951642.656009:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.656029:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.656040:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951642.656099:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1783951642.656126:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1864755 reply state 00000000542e4dd2 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951642.656136:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783951642.656189:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1783951642.656901:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:9968:x1870608602279808:12345-192.168.201.6@tcp:36:bash.0 Request processed in 1242us (1451us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1783951642.656910:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 89 00000020:00080000:3.0:1783951642.656915:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1783951642.658570:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951642.658586:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951642.658594:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951642.658600:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951642.658605:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951642.658613:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951642.658634:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:2.0:1783951642.658637:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951642.658642:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951642.658649:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eec9e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951642.660939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951642.661411:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602279936 00000100:00100000:1.0:1783951642.661421:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602279936 00000100:00100000:1.0:1783951642.661488:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:1.0:1783951642.661501:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:9968:x1870608602279936:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951642.661529:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951642.661552:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec9e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038724 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.661631:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec9e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038724 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.661654:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec9e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038724 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.661678:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:1.0:1783951642.661682:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951642.661685:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5fc00, rc 0) 00000100:00100000:1.0:1783951642.661757:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:9968:x1870608602279936:12345-192.168.201.6@tcp:101:bash.0 Request processed in 259us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951642.661764:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:3.0:1783951642.669038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951642.669182:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602280064 00000100:00100000:1.0:1783951642.669192:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602280064 00000100:00100000:1.0:1783951642.669343:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:1.0:1783951642.669356:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:9968:x1870608602280064:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951642.669380:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951642.669406:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03872b expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951642.669443:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a54f117, atime: 0x6a54f115, ctime: 0x6a54f117, blocks: 0xb 00010000:00010000:1.0:1783951642.669469:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1783951642.669474:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951642.669483:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.669501:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.669514:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d60d5f200, rc 0) 00000100:00100000:1.0:1783951642.669585:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:9968:x1870608602280064:12345-192.168.201.6@tcp:101:bash.0 Request processed in 233us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951642.669593:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00080000:0.0:1783951642.673022:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951642.675225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951642.675316:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602280192 00000100:00100000:3.0:1783951642.675327:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602280192 00002000:00010000:3.0:1783951642.675372:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1783951642.675376:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d757a7b80 with x1870608602280192 ext(0->18446744073709551615) 00002000:00010000:3.0:1783951642.675411:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d757a7b80. 00000100:00100000:3.0:1783951642.675442:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1783951642.675451:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602280192:12345-192.168.201.6@tcp:10:bash.0 00002000:00010000:3.0:1783951642.675727:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783951642.675731:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783951639 -> 1783951643 00002000:00010000:3.0:1783951642.675733:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1783951637 -> 1783951637 00002000:00010000:3.0:1783951642.675736:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783951639 -> 1783951643 00002000:00010000:3.0:1783951642.675738:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1783951642.675830:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602280192:12345-192.168.201.6@tcp:10:bash.0 Request processed in 358us (603us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783951642.675838:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00002000:00010000:3.0:1783951642.675841:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1783951642.675844:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d757a7b80 with x1870608602280192 ext(0->18446744073709551615) 00002000:00010000:3.0:1783951642.675848:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d757a7b80. 00000100:00100000:2.0:1783951642.816798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951642.817113:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602280320 00000100:00100000:1.0:1783951642.817123:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602280320 00000100:00100000:1.0:1783951642.817185:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:1.0:1783951642.817194:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10463:x1870608602280320:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:1.0:1783951642.817276:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.817304:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.817327:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.817342:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.817348:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.817352:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818008:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818019:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818024:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951642.818064:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818075:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818079:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818084:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818096:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951642.818099:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818105:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818114:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951642.818116:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951642.818119:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818122:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e000/0x443dabd358eec9f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818131:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818134:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818138:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818141:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951642.818142:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818145:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818155:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6df00) 00010000:00010000:1.0:1783951642.818156:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951642.818158:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818161:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e600/0x443dabd358eec9fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818171:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818174:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818177:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818180:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29a00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951642.818182:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818186:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818189:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:1.0:1783951642.818190:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951642.818192:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.818195:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951642.818274:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10463:x1870608602280320:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1079us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951642.818293:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:2.0:1783951642.850193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951642.851109:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602280576 00000100:00100000:1.0:1783951642.851118:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602280576 00000100:00100000:1.0:1783951642.851215:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:1.0:1783951642.851223:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:10466:x1870608602280576:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951642.851244:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951642.851275:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851364:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851376:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851384:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851393:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851405:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851409:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851681:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851689:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851693:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951642.851700:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783951642.851804:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851828:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851832:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851836:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951642.851839:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851844:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851853:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951642.851855:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951642.851858:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851868:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851877:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851885:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851889:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851892:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951642.851893:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851897:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851901:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6df00) 00010000:00010000:1.0:1783951642.851902:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951642.851903:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851906:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851936:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29a00/0x443dabd358eeca0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038732 expref: 30 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851945:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038732 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.851954:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:1.0:1783951642.851956:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783951642.851958:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28a00, rc 0) 00000100:00100000:1.0:1783951642.852026:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:10466:x1870608602280576:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 803us (1845us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1783951642.852034:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:2.0:1783951642.854493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951642.861096:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602280704 00000100:00100000:0.0:1783951642.861115:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602280704 00000100:00100000:3.0:1783951642.861243:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:3.0:1783951642.861269:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:10466:x1870608602280704:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1783951642.861362:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.861381:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.861391:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.861443:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.861473:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 29 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951642.861487:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81199f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624319488:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951642.861596:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951642.875512:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81199f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624319488:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951642.875549:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951642.876742:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951642.879959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951642.882984:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602280960 00000100:00100000:3.0:1783951642.883000:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602280960 00000100:00100000:2.0:1783951642.883183:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1783951642.883196:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+30:5574:x1870608602280960:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783951642.883923:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:5574:x1870608602280960:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 617us (3863us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783951642.883932:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1783951642.887918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951642.888021:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602281088 00000100:00100000:3.0:1783951642.888087:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602281088 00010000:00010000:3.0:1783951642.888133:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 31 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951642.888219:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:3.0:1783951642.888245:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:2358:x1870608602281088:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951642.888270:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951642.888289:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 31 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.888304:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 31 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.888328:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eec9d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03871d expref: 31 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.888364:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:3.0:1783951642.888370:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.888380:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.888388:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951642.888552:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951642.888619:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+30:2358:x1870608602281088:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 390us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951642.888628:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00010000:00010000:1.0:1783951642.888698:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.888707:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.888744:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.888752:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.888759:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.888765:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951642.888769:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.888790:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.888800:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:1.0:1783951642.888831:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951642.888837:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951642.888843:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eeca2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951642.888885:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:10466:x1870608602280704:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 27623us (34402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951642.888894:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:2.0:1783951642.903146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951642.904527:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602281344 00000100:00100000:0.0:1783951642.904541:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602281344 00000100:00100000:0.0:1783951642.904638:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1783951642.904650:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:10466:x1870608602281344:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1783951642.905156:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+30:10466:x1870608602281344:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 507us (2021us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1783951642.905165:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1783951642.966168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951642.966224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951642.966294:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602281472 00000100:00100000:3.0:1783951642.966305:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602281472 00000100:00100000:1.0:1783951642.966335:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602281600 00000100:00100000:1.0:1783951642.966340:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602281600 00002000:00100000:3.0:1783951642.966358:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff8e8d65ccfb80 x1870608602281472/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:658/0 lens 496/0 e 0 to 0 dl 1783951653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951642.966369:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d65ccfb80 with x1870608602281472 ext(0->7) 00002000:00010000:3.0:1783951642.966375:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d65ccfb80 00000100:00100000:3.0:1783951642.966409:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1783951642.966421:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2358:x1870608602281472:12345-192.168.201.6@tcp:4:bash.0 00000100:00100000:1.0:1783951642.966470:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1783951642.966479:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2358:x1870608602281600:12345-192.168.201.6@tcp:16:kworker.0 00000100:00100000:3.0:1783951642.967140:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:2358:x1870608602281472:12345-192.168.201.6@tcp:4:bash.0 Request processed in 718us (981us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783951642.967149:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00002000:00100000:3.0:1783951642.967158:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff8e8d65ccfb80 x1870608602281472/t4294967307(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:658/0 lens 496/448 e 0 to 0 dl 1783951653 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951642.967173:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d65ccfb80 with x1870608602281472 ext(0->7) 00002000:00010000:3.0:1783951642.967178:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d65ccfb80 00000100:00100000:2.0:1783951642.998111:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624320000:0@lo:400:kworker.0 00000100:00100000:2.0:1783951642.998194:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951642.998261:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951642.998268:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624319872:0@lo:400:kworker.0 00000100:00100000:2.0:1783951642.998304:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951642.999016:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624319744:0@lo:400:kworker.0 00000100:00100000:1.0:1783951642.999070:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951642.999096:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624320256:0@lo:400:kworker.0 00000100:00100000:1.0:1783951642.999120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951642.999149:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783951642.999155:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624319616:0@lo:400:kworker.0 00000100:00100000:1.0:1783951642.999183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951642.999201:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624320128:0@lo:400:kworker.0 00000100:00100000:1.0:1783951642.999221:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951642.999253:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624320000 00000100:00100000:1.0:1783951642.999260:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624320000 00000100:00100000:1.0:1783951642.999319:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624320256 00000100:00100000:1.0:1783951642.999323:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624320256 00000100:00100000:1.0:1783951642.999342:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783951642.999359:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624320000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.000485:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624320000:12345-0@lo:400:kworker.0 Request processed in 1120us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.000496:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783951643.000521:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951643.000531:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1870608624320256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.000574:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1870608624320256:12345-0@lo:400:kworker.0 Request processed in 47us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.000580:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951643.000622:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624319872 00000100:00100000:1.0:1783951643.000627:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624319872 00000100:00100000:1.0:1783951643.000660:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624319744 00000100:00100000:1.0:1783951643.000663:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624319744 00000100:00100000:1.0:1783951643.000676:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624320128 00000100:00100000:1.0:1783951643.000678:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624320128 00000100:00100000:1.0:1783951643.000692:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783951643.000697:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624319872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.000730:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624319872:12345-0@lo:400:kworker.0 Request processed in 32us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.000736:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783951643.000748:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783951643.000754:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624319744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.000778:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624319744:12345-0@lo:400:kworker.0 Request processed in 25us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.000784:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783951643.000795:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783951643.000801:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624320128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.000865:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624320128:12345-0@lo:400:kworker.0 Request processed in 64us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.000871:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783951643.001014:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624319616 00000100:00100000:0.0:1783951643.001019:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624319616 00000100:00100000:0.0:1783951643.001050:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1783951643.001057:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624319616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951643.001093:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624319616:12345-0@lo:400:kworker.0 Request processed in 37us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951643.001099:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1783951643.001448:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951643.001454:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951643.001456:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951643.003203:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624319616:0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.003225:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624320128:0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.003238:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624319744:0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.003251:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624320256:0@lo:400:kworker.0 00000100:00100000:2.0:1783951643.013255:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624320000:0@lo:400:kworker.0 00000100:00100000:2.0:1783951643.013410:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624319872:0@lo:400:kworker.0 00000100:00100000:1.0:1783951643.026354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.026397:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602281856 00000100:00100000:1.0:1783951643.026406:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602281856 00000100:00100000:1.0:1783951643.026464:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:1.0:1783951643.026476:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+30:10477:x1870608602281856:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:1.0:1783951643.026507:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951643.026531:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038739 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.026758:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.026774:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.026786:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.026799:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.026849:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.026856:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027214:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027223:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027230:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951643.027242:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1783951643.027366:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027375:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027381:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027388:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.027392:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027400:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027423:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951643.027426:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951643.027432:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027439:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027453:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027459:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027465:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027469:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.027473:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027479:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027487:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6df00) 00010000:00010000:1.0:1783951643.027489:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951643.027492:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027497:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027555:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038739 expref: 33 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027569:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038739 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.027576:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:1.0:1783951643.027578:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951643.027581:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28200, rc 0) 00000100:00100000:1.0:1783951643.027671:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:10477:x1870608602281856:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1198us (1328us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1783951643.027681:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:3.0:1783951643.036244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.036492:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602282112 00000100:00100000:2.0:1783951643.036503:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602282112 00000100:00100000:2.0:1783951643.036589:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:2.0:1783951643.036600:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:10477:x1870608602282112:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:2.0:1783951643.036858:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:10477:x1870608602282112:12345-192.168.201.6@tcp:35:cat.0 Request processed in 259us (625us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1783951643.036865:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000001:00080000:3.0:1783951643.076240:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1783951643.076258:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1783951643.076264:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:0.0:1783951643.077751:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602281600:12345-192.168.201.6@tcp:16:kworker.0 Request processed in 111263us (111516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951643.077765:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:3.0:1783951643.104145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.104187:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602282368 00000100:00100000:1.0:1783951643.104196:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602282368 00000100:00100000:1.0:1783951643.104371:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:1.0:1783951643.104382:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:10478:x1870608602282368:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:1.0:1783951643.104442:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783951643.104468:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038739 expref: 33 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.104485:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038732 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.104493:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5fc00/0x443dabd358eec9e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038724 expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.104518:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d452ae600) 00010000:00010000:1.0:1783951643.104529:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951643.104551:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.104566:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.104577:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.104593:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.104600:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.104607:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105014:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105021:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105026:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951643.105787:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1783951643.105799:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360010988346ns, next at 361010985349ns, rc = 0 00010000:00010000:1.0:1783951643.105904:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105915:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105924:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105932:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105939:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105945:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.105962:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951643.106370:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106378:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106385:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106391:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.106396:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106404:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106427:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:1.0:1783951643.106429:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783951643.106435:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106440:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca67 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106459:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106466:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106471:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106475:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.106478:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106483:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106490:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951643.106492:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951643.106494:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.106499:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951643.106520:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f28d6ff7 reply state 00000000256eee18 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.106530:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951643.106644:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:10478:x1870608602282368:12345-192.168.201.6@tcp:36:rm.0 Request processed in 2261us (2506us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1783951643.106654:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00010000:00010000:3.0:1783951643.107421:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951643.107431:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.107439:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951643.107444:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.107452:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.107464:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951643.107466:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783951643.107469:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.107475:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eeca6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951643.121663:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1783951643.121772:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951643.121776:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951643.121778:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951643.122230:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.122243:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.122252:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.122258:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951643.122263:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.122271:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.122303:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6df00) 00010000:00010000:3.0:1783951643.122307:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951643.122312:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.122318:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eeca60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.161301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.161770:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602282624 00000100:00100000:1.0:1783951643.161790:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602282624 00000100:00100000:1.0:1783951643.161916:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:1.0:1783951643.161930:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:10484:x1870608602282624:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951643.161962:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951643.161986:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.162147:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.162167:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.162182:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.162199:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.162206:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.162255:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783951643.162929:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1783951643.163130:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163141:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163150:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163189:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163196:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163203:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163209:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.163214:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163222:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163233:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951643.163236:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951643.163249:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163256:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eeca7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951643.163270:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7fdf35d reply state 00000000e6f1097e transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.163293:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783951643.163326:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eeca75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163341:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 33 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.163348:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:1.0:1783951643.163350:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951643.163353:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28200, rc 0) 00000100:00100000:1.0:1783951643.163450:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:10484:x1870608602282624:12345-192.168.201.6@tcp:101:bash.0 Request processed in 1521us (2181us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1783951643.163459:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 96 00010000:00010000:0.0:1783951643.166102:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.166122:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.166131:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.166138:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28a00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951643.166143:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.166152:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.166169:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6d800) 00010000:00010000:0.0:1783951643.166172:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951643.166178:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.166184:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eeca83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.174385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.174508:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602282752 00000100:00100000:1.0:1783951643.174521:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602282752 00000100:00100000:1.0:1783951643.174667:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1783951643.174679:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602282752:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951643.174699:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951643.174721:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038747 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951643.174781:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783951643.174802:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1783951643.174835:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951643.174848:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.174871:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.174886:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28e00, rc 0) 00000100:00100000:1.0:1783951643.174950:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602282752:12345-192.168.201.6@tcp:101:bash.0 Request processed in 274us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.174957:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00080000:0.0:1783951643.176406:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951643.182503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.182699:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602282880 00000100:00100000:1.0:1783951643.182711:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602282880 00000100:00100000:0.0:1783951643.182878:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:0.0:1783951643.182893:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:10484:x1870608602282880:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1783951643.182914:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951643.182937:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03874e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.183005:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.183015:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951643.183021:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951643.183027:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.183070:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.183085:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 7 pid: 6589 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951643.183101:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d75a5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1870608624320384:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951643.183882:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de6780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951643.186246:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d75a5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1870608624320384:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951643.186290:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.186314:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4200, rc 0) 00000100:00100000:0.0:1783951643.186369:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:10484:x1870608602282880:12345-192.168.201.6@tcp:101:bash.0 Request processed in 3479us (4143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951643.186378:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1783951643.188485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.189541:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602283008 00000100:00100000:1.0:1783951643.189553:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602283008 00010000:00010000:1.0:1783951643.189605:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 7 pid: 6589 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.189647:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1783951643.189657:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602283008:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951643.189677:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951643.189703:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 7 pid: 6589 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.190398:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 7 pid: 6589 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.190430:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f4a6f86/0x443dabd358eeca98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038747 expref: 7 pid: 6589 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.190452:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951643.190457:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951643.190467:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.190478:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.190527:0:8312:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.190542:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8312:1870608624320512:192.168.201.6@tcp:105: 00000100:00100000:1.0:1783951643.190686:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5a43c240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951643.197401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951643.197571:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602283264 00000100:00100000:3.0:1783951643.197582:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602283264 00000100:00100000:3.0:1783951643.197646:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1783951643.197657:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:10484:x1870608602283264:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:3.0:1783951643.198423:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:10484:x1870608602283264:12345-192.168.201.6@tcp:35:bash.0 Request processed in 766us (1032us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1783951643.198433:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:1.0:1783951643.200120:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8312:1870608624320512:192.168.201.6@tcp:105: 00010000:00010000:1.0:1783951643.200152:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951643.200279:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602283008:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 10613us (11792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.200290:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1783951643.396345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951643.396617:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602283392 00000100:00100000:3.0:1783951643.396629:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602283392 00000100:00100000:3.0:1783951643.396904:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:3.0:1783951643.396917:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:10500:x1870608602283392:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951643.396946:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951643.396979:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecaa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038755 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.397050:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecaad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.397066:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecaad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.397078:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecaad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951643.397153:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1783951643.397157:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951643.397184:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecaad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.397208:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecaa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038755 expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.397227:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecaad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038755 expref: 35 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.397252:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:3.0:1783951643.397256:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951643.397259:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8800, rc 0) 00000100:00100000:3.0:1783951643.397332:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:10500:x1870608602283392:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 419us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951643.397341:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:3.0:1783951643.403730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.404224:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602283648 00000100:00100000:2.0:1783951643.404235:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602283648 00000100:00100000:2.0:1783951643.404311:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:2.0:1783951643.404322:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:10500:x1870608602283648:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951643.404345:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951643.404368:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecab4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03875c expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.404484:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecabb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.404500:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecabb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.404514:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecabb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951643.404526:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783951643.404670:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecab4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03875c expref: 38 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.404690:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecabb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03875c expref: 37 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.404700:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:2.0:1783951643.404702:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951643.404706:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f000, rc 0) 00000100:00100000:2.0:1783951643.404796:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:10500:x1870608602283648:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 474us (1088us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783951643.404876:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:0.0:1783951643.409212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951643.409446:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602283904 00000100:00100000:3.0:1783951643.409456:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602283904 00000100:00100000:3.0:1783951643.409509:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1783951643.409517:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:10500:x1870608602283904:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951643.409541:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951643.409563:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecac9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038763 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.409667:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.409690:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.409699:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951643.409713:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783951643.409874:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038763 expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.409914:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038763 expref: 39 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.409923:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:3.0:1783951643.409927:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783951643.409930:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:3.0:1783951643.410012:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:10500:x1870608602283904:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 494us (807us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1783951643.410019:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1783951643.414419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.414492:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602284032 00000100:00100000:2.0:1783951643.414501:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602284032 00000100:00100000:2.0:1783951643.414562:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1783951643.414572:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:2360:x1870608602284032:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951643.414591:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951643.414619:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecabb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03875c expref: 39 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.414634:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:2.0:1783951643.414638:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951643.414696:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+38:2360:x1870608602284032:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 126us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951643.414701:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1783951643.419987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951643.420193:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602284160 00000100:00100000:3.0:1783951643.420204:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602284160 00000100:00100000:3.0:1783951643.420276:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1783951643.420287:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602284160:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:3.0:1783951643.420337:0:8067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.420359:0:8067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.420367:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951643.420371:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951643.420376:0:8067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.420416:0:8067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.420449:0:8067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 6 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.420466:0:8067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8067:1870608624320640:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951643.420573:0:8067:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71d6a900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951643.424246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.424365:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602284288 00000100:00100000:2.0:1783951643.424375:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602284288 00002000:00100000:2.0:1783951643.424429:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e8d75a5a680 x1870608602284288/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:659/0 lens 504/0 e 0 to 0 dl 1783951654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783951643.424441:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d75a5a680 with x1870608602284288 ext(0->8) 00010000:00010000:2.0:1783951643.424450:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 7 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.424467:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 7 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951643.424497:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8d75a5a680 00000100:00100000:2.0:1783951643.424537:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1783951643.424548:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602284288:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:2.0:1783951643.425601:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2358:x1870608602284288:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 1044us (1354us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783951643.425613:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00002000:00100000:2.0:1783951643.425623:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e8d75a5a680 x1870608602284288/t4294967302(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:659/0 lens 504/448 e 0 to 0 dl 1783951654 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783951643.425632:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d75a5a680 with x1870608602284288 ext(0->8) 00010000:00010000:2.0:1783951643.425643:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 9 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.425659:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 9 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951643.425666:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8d75a5a680 00000100:00100000:3.0:1783951643.426639:0:8067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8067:1870608624320640:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951643.426667:0:8067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951643.430255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951643.430370:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602284416 00000100:00100000:0.0:1783951643.430381:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602284416 00010000:00010000:0.0:1783951643.430432:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 9 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951643.430480:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1783951643.430491:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2361:x1870608602284416:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951643.430507:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783951643.430529:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783951643.430532:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783951643 00002000:00010000:0.0:1783951643.430534:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783951643 00002000:00010000:0.0:1783951643.430536:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783951643 00010000:00010000:0.0:1783951643.430542:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 9 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.430554:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 9 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.430577:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc40c86c/0x443dabd358eeca9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03874e expref: 9 pid: 6591 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.430592:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951643.430597:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951643.430602:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.430631:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.430661:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951643.430917:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2361:x1870608602284416:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 426us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951643.430925:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00010000:00010000:3.0:1783951643.431755:0:8067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.432061:0:8067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.432099:0:8067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.432108:0:8067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.432116:0:8067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.432144:0:8067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951643.432149:0:8067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.432158:0:8067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.432177:0:8067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.432184:0:8067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000401108c5/0x443dabd358eecade lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.432289:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602284160:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 12000us (12309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951643.432298:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:2.0:1783951643.436746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951643.436860:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602284672 00000100:00100000:3.0:1783951643.436871:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602284672 00000100:00100000:3.0:1783951643.436926:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:3.0:1783951643.436936:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d518aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+38:10500:x1870608602284672:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:3.0:1783951643.437013:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038763 expref: 38 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951643.437315:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1783951643.437366:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1783951643.437752:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1783951643.437845:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.437861:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.437869:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.437909:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.437924:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 42 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.437942:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1870608624320768:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951643.438028:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71d6a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783951643.442311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.442413:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602284800 00000100:00100000:2.0:1783951643.442426:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602284800 00010000:00010000:2.0:1783951643.442478:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 43 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951643.442528:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:2.0:1783951643.442553:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:2359:x1870608602284800:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951643.442571:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951643.442579:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 43 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.442594:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 43 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.442618:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:2.0:1783951643.442624:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.442636:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.442644:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.442663:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951643.442737:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:2359:x1870608602284800:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 185us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951643.442744:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00010000:00010000:3.0:1783951643.443335:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eeca8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038740 expref: 42 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.443357:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1870608624320768:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951643.443379:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.443389:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.443396:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951643.443566:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1783951643.444113:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1783951643.444235:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624320896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783951643.444304:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951643.444336:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951643.444404:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624320896 00000100:00100000:0.0:1783951643.444411:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624320896 00000100:00100000:0.0:1783951643.444473:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951643.444483:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1870608624320896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783951643.444569:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1870608624320896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951643.444577:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951643.444648:0:5794:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1783951643.444654:0:5794:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1783951643.444673:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d7f726300, transno 4294967301 00000100:00100000:3.0:1783951643.444694:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624320896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783951643.445530:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1783951643.445590:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624321024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783951643.445627:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951643.445655:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951643.446119:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624321024 00000100:00100000:2.0:1783951643.446127:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624321024 00000100:00100000:2.0:1783951643.446162:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783951643.446171:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1870608624321024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783951643.446362:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1870608624321024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 192us (734us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783951643.446382:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951643.447229:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624321024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783951643.447333:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1783951643.447397:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.447410:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.447420:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.447427:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951643.447432:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.447455:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.447472:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:3.0:1783951643.447475:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783951643.447479:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.447485:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecae5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951643.447719:0:5794:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783951643.449518:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1783951643.449539:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360354727647ns, next at 361354723870ns, rc = 0 00000001:00080000:3.0:1783951643.449554:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1783951643.449621:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:3.0:1783951643.449626:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783951643.449639:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038763 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.450580:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d518aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:10500:x1870608602284672:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 13638us (13839us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1783951643.450593:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000020:00080000:3.0:1783951643.450600:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783951643.454308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.454412:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602284928 00000100:00100000:2.0:1783951643.454422:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602284928 00000100:00100000:2.0:1783951643.454529:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:2.0:1783951643.454540:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:10500:x1870608602284928:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951643.454567:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951643.454592:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecaec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03876a expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.454666:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecaec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03876a expref: 46 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.454684:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecaec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03876a expref: 46 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.454719:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951643.454723:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951643.454727:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f000, rc 0) 00000100:00100000:2.0:1783951643.454804:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+46:10500:x1870608602284928:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 265us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951643.454847:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:0.0:1783951643.458903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.459065:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602285184 00000100:00100000:2.0:1783951643.459076:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602285184 00000100:00100000:2.0:1783951643.459138:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1783951643.459149:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+46:10500:x1870608602285184:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1783951643.459431:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:10500:x1870608602285184:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 282us (538us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1783951643.459455:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:3.0:1783951643.510559:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951643.510587:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624321152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951643.510670:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951643.510840:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624321152 00000100:00100000:1.0:1783951643.510849:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624321152 00000100:00100000:1.0:1783951643.510910:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783951643.510921:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624321152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951643.510950:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951643.511019:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624321152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.511027:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783951643.511122:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624321152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951643.553101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.553306:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602285312 00000100:00100000:1.0:1783951643.553317:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602285312 00000100:00100000:1.0:1783951643.553373:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:1.0:1783951643.553381:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:10510:x1870608602285312:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:1.0:1783951643.553460:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553474:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553484:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553495:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553499:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553503:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553626:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553636:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553644:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951643.553695:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553705:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553878:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553886:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553891:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.553894:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553899:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553908:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951643.553910:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951643.553913:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553922:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecaf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553934:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553937:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553940:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553944:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.553945:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553948:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.553952:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6d500) 00010000:00010000:1.0:1783951643.553954:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951643.553955:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.554044:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecafa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.554055:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.554058:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.554067:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.554070:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.554072:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.554075:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.554081:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951643.554083:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951643.554085:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.554088:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.554150:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:10510:x1870608602285312:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 769us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.554157:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:1.0:1783951643.593441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.593580:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602285568 00000100:00100000:2.0:1783951643.593591:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602285568 00000100:00100000:2.0:1783951643.593654:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:2.0:1783951643.593665:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:10513:x1870608602285568:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951643.593696:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951643.593729:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038771 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.593998:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594010:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594019:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594029:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594034:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594038:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594330:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594350:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594356:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951643.594363:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783951643.594452:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594458:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594462:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594466:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951643.594469:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594474:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594482:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:2.0:1783951643.594484:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951643.594487:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594491:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594504:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594516:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594521:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594527:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fe00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951643.594530:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594537:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594545:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d44e70900) 00010000:00010000:2.0:1783951643.594547:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951643.594550:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594555:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594599:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594614:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 49 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.594621:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951643.594624:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951643.594632:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165ec00, rc 0) 00000100:00100000:2.0:1783951643.595204:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+49:10513:x1870608602285568:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1539us (1769us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1783951643.595210:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:3.0:1783951643.599387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.600097:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602285696 00000100:00100000:1.0:1783951643.600108:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602285696 00000100:00100000:1.0:1783951643.600193:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:1.0:1783951643.600202:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+49:10513:x1870608602285696:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1783951643.600292:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600329:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600343:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600373:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600377:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600382:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600386:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951643.600389:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600394:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600403:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951643.600405:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951643.600408:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.600412:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.600490:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+49:10513:x1870608602285696:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 289us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.600504:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:2.0:1783951643.603367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.603403:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602285952 00000100:00100000:2.0:1783951643.603412:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602285952 00000100:00100000:2.0:1783951643.603455:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:2.0:1783951643.603464:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+49:10513:x1870608602285952:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1783951643.603750:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:10513:x1870608602285952:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 286us (392us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1783951643.603757:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:2.0:1783951643.704526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.704639:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602286208 00000100:00100000:1.0:1783951643.704649:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602286208 00000100:00100000:1.0:1783951643.704720:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:1.0:1783951643.704731:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:10523:x1870608602286208:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951643.704762:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951643.704766:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783951643.704858:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecaad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038755 expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.704890:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951643.704897:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951643.704914:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038778 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.705044:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.705059:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.705068:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.705110:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.705126:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 50 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.705163:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624321280:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951643.705502:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5a43c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951643.721283:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624321280:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951643.721329:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951643.724281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.724912:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602286336 00000100:00100000:1.0:1783951643.724926:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602286336 00010000:00010000:1.0:1783951643.724991:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 51 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.725043:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:1.0:1783951643.725054:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+51:2359:x1870608602286336:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951643.725073:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951643.725081:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 51 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.725095:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 51 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.725121:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038771 expref: 51 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.725141:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951643.725148:0:8312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.725176:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.725183:0:8312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.725230:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951643.725484:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:2359:x1870608602286336:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 431us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.725493:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00010000:00010000:2.0:1783951643.725722:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.725732:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951643.725756:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783951643.726022:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecb32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.726039:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 50 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.726045:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951643.726055:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783951643.726058:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28600, rc 0) 00000100:00100000:2.0:1783951643.726090:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:10523:x1870608602286208:12345-192.168.201.6@tcp:101:bash.0 Request processed in 21362us (21576us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783951643.726097:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:0.0:1783951643.731783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.731936:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602286592 00000100:00100000:1.0:1783951643.731947:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602286592 00000100:00100000:1.0:1783951643.732021:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:1.0:1783951643.732032:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:10523:x1870608602286592:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:1.0:1783951643.732400:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.732418:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.732430:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951643.732487:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1783951643.732512:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040056f25 reply state 0000000071484122 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.732522:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951643.733658:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+53:10523:x1870608602286592:12345-192.168.201.6@tcp:36:bash.0 Request processed in 1622us (1890us total) trans 4294967394 rc 0/0 00010000:00010000:0.0:1783951643.736087:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.736111:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.736120:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.736126:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951643.736149:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.736171:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.736195:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:0.0:1783951643.736198:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951643.736204:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951643.736211:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecb47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.736863:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 105 00000020:00080000:1.0:1783951643.736874:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783951643.738581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.738986:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602286720 00000100:00100000:2.0:1783951643.738998:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602286720 00000100:00100000:2.0:1783951643.739058:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:2.0:1783951643.739069:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:10523:x1870608602286720:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951643.739099:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951643.739125:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03877f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.739400:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.739417:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 53 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.739425:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.739462:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 53 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.739477:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 53 pid: 8068 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951643.739494:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81305f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624321408:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951643.739608:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d50b39180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951643.741738:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81305f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624321408:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951643.741776:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951643.743710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.744410:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602286848 00000100:00100000:2.0:1783951643.744424:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602286848 00010000:00010000:2.0:1783951643.744479:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 54 pid: 8068 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951643.744528:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1783951643.744540:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:2358:x1870608602286848:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951643.744559:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951643.744566:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 54 pid: 8068 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.744579:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 54 pid: 8068 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.744604:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecb39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038778 expref: 54 pid: 8068 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.744625:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951643.744632:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.744643:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.744670:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.744947:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951643.745062:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.745072:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951643.745132:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783951643.745136:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951643.745159:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.745188:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 54 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.745205:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 53 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.745222:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951643.745225:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951643.745228:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:1.0:1783951643.745303:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+53:10523:x1870608602286720:12345-192.168.201.6@tcp:101:bash.0 Request processed in 6236us (6733us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.745311:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:2.0:1783951643.746095:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:2358:x1870608602286848:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 1553us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951643.746104:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:0.0:1783951643.750427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.750514:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602287104 00000100:00100000:2.0:1783951643.750526:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602287104 00000100:00100000:2.0:1783951643.750594:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1783951643.750606:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:10523:x1870608602287104:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:2.0:1783951643.750941:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+53:10523:x1870608602287104:12345-192.168.201.6@tcp:35:bash.0 Request processed in 336us (528us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1783951643.750949:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:0.0:1783951643.823225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951643.823344:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602287232 00000100:00100000:3.0:1783951643.823355:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602287232 00000100:00100000:3.0:1783951643.823428:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:3.0:1783951643.823440:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+53:10529:x1870608602287232:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951643.823465:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951643.823486:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecb5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038786 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.823551:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecb63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.823566:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecb63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.823579:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecb63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951643.823655:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1783951643.823660:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951643.823686:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecb63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.823724:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecb5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038786 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.823744:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecb63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038786 expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.823752:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:3.0:1783951643.823777:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951643.823781:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8000, rc 0) 00000100:00100000:3.0:1783951643.823915:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:10529:x1870608602287232:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 476us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951643.823923:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:1.0:1783951643.828871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.829140:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602287360 00000100:00100000:2.0:1783951643.829153:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602287360 00000100:00100000:2.0:1783951643.829226:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:2.0:1783951643.829238:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:10529:x1870608602287360:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951643.829271:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951643.829298:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03878d expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829377:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829393:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829429:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829446:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829454:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829460:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829582:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829590:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829597:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951643.829641:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783951643.829646:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951643.829666:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829690:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829700:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829716:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829723:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829730:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fe00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951643.829735:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829743:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829756:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:2.0:1783951643.829760:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951643.829766:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829772:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecb71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829785:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829792:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829798:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829803:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951643.829859:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829864:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829870:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d44e70900) 00010000:00010000:2.0:1783951643.829872:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951643.829874:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829878:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecb78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829904:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03878d expref: 56 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829914:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03878d expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.829919:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951643.829920:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951643.829922:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165ec00, rc 0) 00000100:00100000:2.0:1783951643.829986:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:10529:x1870608602287360:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 752us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951643.829991:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:0.0:1783951643.836926:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951643.836982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.837217:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602287744 00000100:00100000:1.0:1783951643.837228:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602287744 00000100:00100000:1.0:1783951643.837304:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783951643.837331:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:2358:x1870608602287744:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951643.837351:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951643.837383:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecb7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03878d expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.837405:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951643.837410:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951643.837480:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:2358:x1870608602287744:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 152us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.837488:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1783951643.837605:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602287616 00000100:00100000:3.0:1783951643.837610:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602287616 00000100:00100000:3.0:1783951643.837648:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:3.0:1783951643.837656:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:10529:x1870608602287616:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951643.837680:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951643.837698:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecb86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038794 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.837842:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.837857:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.837865:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.837898:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.837912:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 55 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.837925:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81199880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624321536:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951643.838012:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951643.842420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.842504:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602287872 00000100:00100000:1.0:1783951643.842514:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602287872 00010000:00010000:1.0:1783951643.842562:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 56 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951643.842604:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1783951643.842614:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:2359:x1870608602287872:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951643.842636:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951643.842644:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 56 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.842660:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 56 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.842695:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951643.842702:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.842740:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.842748:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.842777:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951643.842861:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:2359:x1870608602287872:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 248us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.842869:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00010000:00010000:3.0:1783951643.843364:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecb55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03877f expref: 55 pid: 5793 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951643.843385:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81199880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624321536:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951643.843404:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.843413:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.843418:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951643.843436:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783951643.843606:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecb86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.843622:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951643.843631:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:3.0:1783951643.843634:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951643.843636:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9800, rc 0) 00000100:00100000:3.0:1783951643.843683:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:10529:x1870608602287616:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 6028us (6769us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1783951643.843690:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:0.0:1783951643.847376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.847490:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602288128 00000100:00100000:1.0:1783951643.847502:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602288128 00000100:00100000:1.0:1783951643.847585:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1783951643.847597:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:10529:x1870608602288128:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:1.0:1783951643.847617:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951643.847651:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecaec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03876a expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.847673:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951643.847679:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951643.847753:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:10529:x1870608602288128:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 158us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.847769:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1783951643.850507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.850614:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602288256 00000100:00100000:2.0:1783951643.850624:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602288256 00000100:00100000:2.0:1783951643.850693:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:2.0:1783951643.850704:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:10529:x1870608602288256:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:2.0:1783951643.850889:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.850907:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951643.850920:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951643.851154:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1783951643.851255:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:10529:x1870608602288256:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 551us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951643.851278:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:0.0:1783951643.854159:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951643.854256:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602288384 00000100:00100000:1.0:1783951643.854276:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602288384 00000100:00100000:1.0:1783951643.854348:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 111 00000100:00100000:1.0:1783951643.854358:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:10529:x1870608602288384:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951643.854396:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951643.854422:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03879b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.854497:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.854510:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03879b expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.854532:0:5792:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.854546:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03879b expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.854559:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951643.854563:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951643.854566:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03879b expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951643.854574:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28c00, rc 0) 00000100:00100000:1.0:1783951643.854642:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:10529:x1870608602288384:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 285us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.854650:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 111 00010000:00010000:0.0:1783951643.894021:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951643.985493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951643.985550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951643.985650:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602288512 00000100:00100000:2.0:1783951643.985662:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602288512 00000100:00100000:2.0:1783951643.985741:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 283 00000100:00100000:2.0:1783951643.985752:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602288512:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951643.986024:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602288512:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 273us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951643.986033:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 283 00000100:00100000:1.0:1783951643.987299:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602288640 00000100:00100000:1.0:1783951643.987310:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602288640 00000100:00100000:1.0:1783951643.987378:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:1.0:1783951643.987388:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602288640:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951643.987475:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2359:x1870608602288640:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951643.987483:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00080000:0.0:1783951643.988585:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1783951644.534091:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951644.534102:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951644.534164:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1783951644.534187:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951644.534343:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ac4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624321664:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783951644.534469:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d60451180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951644.542215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.542311:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602288768 00000100:00100000:1.0:1783951644.542323:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602288768 00000100:00100000:1.0:1783951644.542410:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:1.0:1783951644.542423:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:10530:x1870608602288768:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783951644.542466:0:5792:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783951644.542602:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:10530:x1870608602288768:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951644.542610:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:2.0:1783951644.542804:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ac4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624321664:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1783951644.543293:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951644.547745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.547881:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602288896 00000100:00100000:1.0:1783951644.547893:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602288896 00000100:00100000:1.0:1783951644.547979:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:1.0:1783951644.547992:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:10530:x1870608602288896:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783951644.548075:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548094:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548109:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548183:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548191:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548230:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548268:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548277:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548283:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951644.548333:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783951644.548338:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951644.548354:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548367:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548373:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548380:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548399:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951644.548403:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548411:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548433:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:1.0:1783951644.548436:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951644.548441:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548447:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecba9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548463:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548469:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548475:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548481:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951644.548484:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548489:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548496:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e8d71d6d500) 00010000:00010000:1.0:1783951644.548499:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951644.548501:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548508:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecbb0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548534:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548541:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548547:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548552:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951644.548556:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548562:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548570:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951644.548573:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951644.548576:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.548583:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecbb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951644.548660:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:10530:x1870608602288896:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 670us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951644.548669:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:1.0:1783951644.553588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951644.557918:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602289152 00000100:00100000:0.0:1783951644.557936:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602289152 00000100:00100000:0.0:1783951644.558178:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:0.0:1783951644.558190:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:10530:x1870608602289152:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951644.558327:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951644.558350:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eecbbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387a2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.558890:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.558907:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.558920:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951644.558931:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783951644.559357:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.559366:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.559374:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.559380:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951644.559922:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.559932:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.560189:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:0.0:1783951644.560194:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951644.560271:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.560280:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eecbc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.560349:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eecbbe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387a2 expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.560362:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:0.0:1783951644.560364:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951644.560368:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eecbbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387a2 expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.560377:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5e00, rc 0) 00000100:00100000:0.0:1783951644.561170:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:10530:x1870608602289152:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 2977us (7587us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1783951644.561182:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:3.0:1783951644.570319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951644.570413:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602289280 00000100:00100000:2.0:1783951644.570424:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602289280 00000100:00100000:2.0:1783951644.570495:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:2.0:1783951644.570506:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:10530:x1870608602289280:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951644.570546:0:8068:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951644.570668:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:10530:x1870608602289280:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 162us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951644.570691:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:3.0:1783951644.575119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951644.575206:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602289536 00000100:00100000:0.0:1783951644.575217:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602289536 00000100:00100000:0.0:1783951644.575290:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:0.0:1783951644.575301:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:10530:x1870608602289536:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951644.575340:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951644.575343:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783951644.575372:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecb63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038786 expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.575393:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:0.0:1783951644.575398:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951644.575413:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecbd3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387a9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951644.575940:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1783951644.576171:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecbda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.576186:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecbda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.576198:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecbda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.576268:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecbd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387a9 expref: 58 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.576288:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecbda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387a9 expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.576297:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951644.576300:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951644.576313:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5800, rc 0) 00000100:00100000:0.0:1783951644.576387:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:10530:x1870608602289536:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1087us (1279us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783951644.576398:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:0.0:1783951644.599378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951644.600106:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602289792 00000100:00100000:2.0:1783951644.600128:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602289792 00000100:00100000:2.0:1783951644.600647:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:2.0:1783951644.600665:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:10530:x1870608602289792:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783951644.600737:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951644.600777:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecbda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387a9 expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.600796:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:2.0:1783951644.600807:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951644.600894:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.600911:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.600922:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.600970:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.600978:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.600984:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601079:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601099:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601106:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601125:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951644.601129:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601137:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601146:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:2.0:1783951644.601148:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951644.601152:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601158:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecbe8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601169:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601174:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601180:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601185:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fe00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951644.601192:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601537:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601548:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xafb4d58d (ffff8e8d44e70900) 00010000:00010000:2.0:1783951644.601551:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951644.601554:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.601560:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecbef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xafb4d58d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951644.601667:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:10530:x1870608602289792:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1005us (2297us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951644.615883:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:0.0:1783951644.623356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951644.623999:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602289920 00000100:00100000:3.0:1783951644.624011:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602289920 00000100:00100000:3.0:1783951644.624081:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:3.0:1783951644.624093:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:10530:x1870608602289920:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951644.624126:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951644.624153:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecbf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387b0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.624207:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.624224:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.624237:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.624373:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecbf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 58 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.624393:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.624403:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:3.0:1783951644.624406:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783951644.624416:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8600, rc 0) 00000100:00100000:3.0:1783951644.624493:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:10530:x1870608602289920:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 403us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951644.624501:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:0.0:1783951644.635219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951644.635409:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602290176 00000100:00100000:3.0:1783951644.635422:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602290176 00000100:00100000:3.0:1783951644.635488:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:3.0:1783951644.635500:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:10530:x1870608602290176:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951644.635626:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.635645:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.635657:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951644.636305:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1783951644.636317:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361541506546ns, next at 362541503657ns, rc = 0 00000004:00010000:3.0:1783951644.636423:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac2d6beb reply state 000000008336d71b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951644.636435:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951644.636951:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:10530:x1870608602290176:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1449us (1750us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1783951644.636961:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:0.0:1783951644.653535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:2.0:1783951644.653688:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.653703:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.653712:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.653719:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951644.653724:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.653733:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.653776:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:2.0:1783951644.653779:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783951644.653784:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951644.653790:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951644.655900:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602290304 00000100:00100000:3.0:1783951644.655916:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602290304 00000100:00100000:3.0:1783951644.656013:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:3.0:1783951644.656024:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+58:10530:x1870608602290304:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951644.656068:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951644.656092:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387b7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.656174:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.656190:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.656555:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:3.0:1783951644.656560:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951644.656563:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:3.0:1783951644.656647:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:10530:x1870608602290304:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 624us (3129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951644.656655:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:0.0:1783951644.668340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.668523:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602290432 00000100:00100000:1.0:1783951644.668537:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602290432 00000100:00100000:1.0:1783951644.668644:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:1.0:1783951644.668657:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602290432:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783951644.669157:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602290432:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 502us (826us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783951644.669167:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00080000:3.0:1783951644.671323:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951644.675685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951644.675796:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602290688 00000100:00100000:2.0:1783951644.675807:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602290688 00000100:00100000:2.0:1783951644.675933:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:2.0:1783951644.675945:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:10530:x1870608602290688:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783951644.677039:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:10530:x1870608602290688:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1090us (1359us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1783951644.677050:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:2.0:1783951644.685727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.694290:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602290944 00000100:00100000:1.0:1783951644.694310:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602290944 00000100:00100000:1.0:1783951644.694573:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:1.0:1783951644.694586:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:10530:x1870608602290944:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783951644.694722:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:10530:x1870608602290944:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 139us (9009us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951644.694729:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:0.0:1783951644.700713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951644.700852:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602291072 00000100:00100000:3.0:1783951644.700863:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602291072 00000100:00100000:3.0:1783951644.700937:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:3.0:1783951644.700959:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:10530:x1870608602291072:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951644.700985:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951644.701007:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387be expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.701085:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecc19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.701120:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.701134:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951644.701180:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951644.701201:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.701228:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecc12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387be expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.701256:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecc19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387be expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.701265:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:3.0:1783951644.701268:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783951644.701272:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8000, rc 0) 00000100:00100000:3.0:1783951644.701350:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:10530:x1870608602291072:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 393us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951644.701357:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:0.0:1783951644.705861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.708481:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602291200 00000100:00100000:1.0:1783951644.708501:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602291200 00000100:00100000:1.0:1783951644.708584:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:1.0:1783951644.708596:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602291200:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951644.708618:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951644.708643:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387c5 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951644.708681:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54f11c, blocks: 0x1 00010000:00010000:1.0:1783951644.708711:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1783951644.708716:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951644.708726:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.708770:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.708785:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29400, rc 0) 00000100:00100000:1.0:1783951644.708881:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602291200:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 286us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951644.708889:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1783951644.722765:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.722888:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602291456 00000100:00100000:1.0:1783951644.722899:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602291456 00000100:00100000:1.0:1783951644.722963:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:1.0:1783951644.722975:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:10530:x1870608602291456:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783951644.723107:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:10530:x1870608602291456:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 134us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951644.723124:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:2.0:1783951644.734705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.734854:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602291584 00000100:00100000:1.0:1783951644.734867:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602291584 00000100:00100000:1.0:1783951644.734927:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:1.0:1783951644.734938:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:10530:x1870608602291584:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951644.734958:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951644.734978:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387cc expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.735011:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 9 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.735040:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951644.735045:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951644.735052:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.735094:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 9 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.735315:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 9 pid: 6589 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951644.735334:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624321792:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951644.735604:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5a43c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951644.745271:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624321792:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951644.745318:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.745342:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29e00, rc 0) 00000100:00100000:1.0:1783951644.745680:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:10530:x1870608602291584:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 10741us (10984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951644.745689:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1783951644.747846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.748258:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602291712 00000100:00100000:1.0:1783951644.748271:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602291712 00010000:00010000:1.0:1783951644.748327:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 9 pid: 6589 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951644.748395:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:1.0:1783951644.748405:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2359:x1870608602291712:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951644.748421:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951644.748446:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 9 pid: 6589 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.748459:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 9 pid: 6589 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.748485:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387c5 expref: 9 pid: 6589 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.748505:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951644.748509:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951644.748518:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.748528:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.748568:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951644.748584:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5777:1870608624321920:192.168.201.6@tcp:105: 00000100:00100000:1.0:1783951644.748683:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5a43c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951644.768541:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5777:1870608624321920:192.168.201.6@tcp:105: 00010000:00010000:1.0:1783951644.768571:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951644.768639:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602291712:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 20234us (20803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951644.768652:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:0.0:1783951644.775647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951644.775755:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602291840 00000100:00100000:2.0:1783951644.775764:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602291840 00002000:00100000:2.0:1783951644.775853:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e8d502d4e00 x1870608602291840/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:660/0 lens 504/0 e 0 to 0 dl 1783951655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783951644.775865:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d502d4e00 with x1870608602291840 ext(0->12) 00002000:00010000:2.0:1783951644.775871:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d502d4e00 00000100:00100000:2.0:1783951644.775899:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:2.0:1783951644.775910:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602291840:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783951644.779585:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:2358:x1870608602291840:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 3602us (3877us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783951644.779602:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00002000:00100000:2.0:1783951644.779617:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e8d502d4e00 x1870608602291840/t4294967309(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:660/0 lens 504/448 e 0 to 0 dl 1783951655 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783951644.779629:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d502d4e00 with x1870608602291840 ext(0->12) 00002000:00010000:2.0:1783951644.779635:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d502d4e00 00000100:00100000:2.0:1783951644.782968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951644.783070:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602291968 00000100:00100000:3.0:1783951644.783082:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602291968 00000100:00100000:3.0:1783951644.783347:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:3.0:1783951644.783359:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:10530:x1870608602291968:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783951644.864787:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:1.0:1783951644.864853:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:1.0:1783951644.864874:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1783951644.864899:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1783951644.864907:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783951644.864922:0:5813:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8d605d0d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783951644.864927:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8c41139700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d605d0f00 00000020:00080000:1.0:1783951644.864930:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8c41139300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d65a99000 00000020:00080000:1.0:1783951644.864962:0:5813:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8d604e7900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783951644.864965:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d75b69000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d604e79c0 00000020:00080000:1.0:1783951644.864968:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d75b69600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d75a52000 00000100:00100000:3.0:1783951644.865355:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:10530:x1870608602291968:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 81993us (82391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951644.865377:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00000020:00080000:3.0:1783951644.865405:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1783951644.865572:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1783951644.865974:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951644.865991:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624322048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783951644.866040:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951644.866323:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624322176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783951644.866352:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951644.866369:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951644.866374:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624322304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783951644.866396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951644.866426:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624322048 00000100:00100000:1.0:1783951644.866433:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624322048 00000100:00100000:1.0:1783951644.866476:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624322176 00000100:00100000:1.0:1783951644.866488:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624322176 00000100:00100000:1.0:1783951644.866501:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624322304 00000100:00100000:1.0:1783951644.866503:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624322304 00000100:00100000:1.0:1783951644.866519:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951644.866527:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624322048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783951644.866552:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1783951644.866577:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.866598:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.866608:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783951644.866612:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951644.866617:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.866646:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.866660:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 9 pid: 6589 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951644.866671:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6591:1870608624322432:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951644.866721:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d465aa900 going to sleep for 11 seconds 00000100:00080000:3.0:1783951644.866836:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951644.866840:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951644.866852:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783951644.866861:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624322176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783951644.866995:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783951644.866998:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783951645 00002000:00010000:3.0:1783951644.867001:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783951644.867003:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783951644 -> 1783951645 00002000:00010000:3.0:1783951644.867005:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783951644.867042:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1870608624322176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (689us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783951644.867049:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783951644.867065:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783951644.867071:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624322304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783951644.867083:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1783951644.867106:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a54f11b, atime: 0x6a54f11b, ctime: 0x6a54f11b, blocks: 0x1 00010000:00010000:3.0:1783951644.867123:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.867131:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1783951644.867134:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951644.867139:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.867163:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.867173:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.867179:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.867315:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951644.868079:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1870608624322304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1006us (1679us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783951644.868089:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1783951644.868180:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951644.868187:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.868198:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951644.868279:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.868291:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.868314:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.868332:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004500eac4/0x443dabd358eecc35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.868358:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951644.868360:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951644.868362:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783951644.868411:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d759a2a00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1783951644.868421:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624322304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783951644.868435:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1783951644.868440:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1783951644.868463:0:3312:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8d759a3800 x1870608624322176/t4294967310(4294967310) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783951660 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783951644.868472:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d759a3800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783951644.868476:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624322176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783951644.879085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951644.879157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.879342:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6591:1870608624322432:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951644.879369:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951644.879465:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602292096 00000100:00100000:0.0:1783951644.879473:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602292096 00000100:00100000:0.0:1783951644.879538:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:0.0:1783951644.879547:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:2359:x1870608602292096:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783951644.884716:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602292224 00000100:00100000:3.0:1783951644.884737:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602292224 00010000:00010000:3.0:1783951644.885682:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 11 pid: 6589 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951644.885725:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:3.0:1783951644.885735:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:2359:x1870608602292224:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951644.885760:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951644.885767:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 11 pid: 6589 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.885798:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 11 pid: 6589 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.885842:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045a20795/0x443dabd358eec9f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03872b expref: 11 pid: 6589 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.885861:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951644.885866:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951644.885872:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.885882:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.885914:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951644.885977:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:2359:x1870608602292224:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 243us (6818us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951644.885986:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00010000:00010000:3.0:1783951644.886150:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.886160:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.886170:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.886186:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.886588:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951644.889672:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624322048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23137us (23622us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783951644.889685:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1783951644.890104:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951644.890346:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.890361:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951644.890367:0:8311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.890378:0:8311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.890526:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.890534:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3706249/0x443dabd358eecc2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951644.890560:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951644.890582:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951644.890584:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783951644.891682:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d759a1500/2, rc 0, transno 4294967311 00000100:00100000:2.0:1783951644.891695:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624322048:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783951644.918557:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783951644.966034:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1783951644.966067:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1783951644.966088:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1783951644.966695:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602292096:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 86829us (87303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951644.966709:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1783951644.969775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.969914:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602292480 00000100:00100000:1.0:1783951644.969928:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602292480 00000100:00100000:1.0:1783951644.970035:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:1.0:1783951644.970046:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:10530:x1870608602292480:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783951644.970113:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951644.970143:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecc19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387be expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.970164:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:1.0:1783951644.970169:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951644.970213:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.970227:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.970238:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951644.970771:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090089e28 reply state 000000003fe6df3d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951644.970782:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951644.971067:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:10530:x1870608602292480:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1021us (1304us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1783951644.971077:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:2.0:1783951644.979729:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:0.0:1783951644.980366:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.980390:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.980399:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.980429:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951644.980434:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.980443:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.980463:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:0.0:1783951644.980466:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951644.980471:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951644.980477:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecc3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951644.980595:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602292608 00000100:00100000:3.0:1783951644.980607:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602292608 00000100:00100000:3.0:1783951644.980711:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1783951644.980723:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602292608:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783951644.981057:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783951644.981061:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1783951645 -> 1783951644 00002000:00010000:3.0:1783951644.981064:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783951643 00002000:00010000:3.0:1783951644.981066:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783951645 -> 1783951644 00002000:00010000:3.0:1783951644.981069:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783951644.981148:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602292608:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 426us (1427us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783951644.981157:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:0.0:1783951644.984513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951644.984609:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602292864 00000100:00100000:1.0:1783951644.984632:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602292864 00000100:00100000:1.0:1783951644.984734:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:1.0:1783951644.984753:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:10530:x1870608602292864:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783951644.985059:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.985079:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.985089:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.985127:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951644.985142:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 15 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951644.985157:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624322560:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951644.985303:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951644.995441:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624322560:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951644.995485:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951644.999671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951645.000269:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602292992 00000100:00100000:2.0:1783951645.000280:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602292992 00010000:00010000:2.0:1783951645.000329:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 16 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951645.000433:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:2.0:1783951645.000445:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:2359:x1870608602292992:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951645.000462:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951645.000486:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 16 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.000499:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 16 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.000524:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecbfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b0 expref: 16 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.000543:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:2.0:1783951645.000549:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.000560:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.000569:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.000606:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951645.000679:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:2359:x1870608602292992:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 235us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951645.000688:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00010000:00010000:0.0:1783951645.000953:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.000963:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.001007:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.001015:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.001023:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.001043:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951645.001048:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.001057:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.001068:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:0.0:1783951645.001071:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783951645.001074:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.001081:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecc43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951645.001142:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:10530:x1870608602292864:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 16398us (16640us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783951645.001151:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:0.0:1783951645.008599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951645.008693:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602293120 00000100:00100000:3.0:1783951645.008708:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602293120 00000100:00100000:3.0:1783951645.008775:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1783951645.008787:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602293120:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783951645.008878:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.008902:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.008931:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951645.008946:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951645.008952:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.008989:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.009002:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 7 pid: 6590 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951645.009017:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6591:1870608624322688:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951645.009097:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d79ed8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951645.016160:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6591:1870608624322688:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951645.016207:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951645.016431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951645.018255:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602293248 00000100:00100000:1.0:1783951645.018273:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602293248 00010000:00010000:1.0:1783951645.018336:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 8 pid: 6590 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951645.018400:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:1.0:1783951645.018412:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602293248:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951645.018432:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951645.018465:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 8 pid: 6590 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.018480:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 8 pid: 6590 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.018509:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd369cee/0x443dabd358eecc27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387cc expref: 8 pid: 6590 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.018531:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951645.018537:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951645.018544:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.018556:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.018632:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951645.018706:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602293248:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 296us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951645.018729:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00010000:00010000:0.0:1783951645.019363:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.019376:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.019414:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.019436:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.019445:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.019452:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951645.019456:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.019464:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.019479:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.019486:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f933ce/0x443dabd358eecc4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951645.019569:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602293120:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 10782us (10980us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951645.019578:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1783951645.023634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951645.023864:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602293504 00000100:00100000:3.0:1783951645.023883:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602293504 00000100:00100000:3.0:1783951645.023948:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:3.0:1783951645.023958:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:10530:x1870608602293504:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783951645.024049:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.024073:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.024087:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.024396:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.024408:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.024416:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.024453:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.024466:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 15 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951645.024483:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624322816:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951645.024582:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d79ed8480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951645.032893:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624322816:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951645.032931:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951645.046731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951645.047298:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602293632 00000100:00100000:1.0:1783951645.047309:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602293632 00010000:00010000:1.0:1783951645.047354:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 16 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951645.047399:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:1.0:1783951645.047409:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:2358:x1870608602293632:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951645.047426:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951645.047433:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 16 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.047446:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 16 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.047469:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387b7 expref: 16 pid: 5791 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.047486:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:1.0:1783951645.047491:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.047500:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.047522:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.047558:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951645.047615:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:2358:x1870608602293632:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 206us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951645.047622:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00010000:00010000:2.0:1783951645.047854:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.047863:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951645.048063:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1783951645.048232:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1783951645.048302:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1783951645.048382:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5793:1870608624322944:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783951645.048430:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951645.048461:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d48198300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951645.050495:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624322944 00000100:00100000:1.0:1783951645.050510:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624322944 00000100:00100000:1.0:1783951645.050568:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951645.050582:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5793:x1870608624322944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783951645.050720:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5793:x1870608624322944:12345-0@lo:1000:mdt00_002.0 Request processed in 143us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951645.050728:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951645.051579:0:5793:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1783951645.051588:0:5793:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d759a3800, transno 4294967310 00000100:00100000:2.0:1783951645.051612:0:5793:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8d759a1500 x1870608624322048/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783951660 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951645.051625:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5793:1870608624322944:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783951645.060870:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1783951645.061185:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5793:1870608624323072:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783951645.061260:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951645.061383:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d79ed83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951645.069926:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624323072 00000100:00100000:1.0:1783951645.070272:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624323072 00000100:00100000:1.0:1783951645.070346:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951645.070359:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5793:x1870608624323072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783951645.071394:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5793:x1870608624323072:12345-0@lo:1000:mdt00_002.0 Request processed in 1035us (10129us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1783951645.071405:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951645.075138:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5793:1870608624323072:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783951645.075221:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075263:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075272:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075279:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951645.075285:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075293:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075310:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:3.0:1783951645.075313:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951645.075319:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075325:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecc58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075365:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075372:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075378:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075395:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951645.075405:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075412:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075421:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:3.0:1783951645.075424:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951645.075432:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03879b expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075444:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03879b expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075453:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03879b expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.075496:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03879b expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951645.075510:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624323200:192.168.201.6@tcp:105: 00000100:00100000:3.0:1783951645.075604:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d79ed83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951645.079003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951645.079314:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602293760 00000100:00100000:2.0:1783951645.079324:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602293760 00000100:00100000:2.0:1783951645.079378:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:2.0:1783951645.079395:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10529:x1870608602293760:12345-192.168.201.6@tcp:49:lfs.0 00000100:00100000:2.0:1783951645.079513:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:10529:x1870608602293760:12345-192.168.201.6@tcp:49:lfs.0 Request processed in 119us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951645.079520:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:1.0:1783951645.081445:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624323200:192.168.201.6@tcp:105: 00010000:00010000:1.0:1783951645.081478:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081489:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecb9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081547:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081562:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081573:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081583:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081588:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081594:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081599:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951645.081603:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081609:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081619:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951645.081622:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951645.081626:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081631:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc5f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081646:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081652:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081658:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081663:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951645.081666:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081672:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081680:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951645.081682:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951645.081685:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.081690:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecc51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951645.082363:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:10530:x1870608602293504:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 58402us (58737us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1783951645.082375:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 127 00000020:00080000:1.0:1783951645.082835:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783951645.090370:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951645.090391:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951645.090930:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783951645.091308:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783951645.092759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951645.096464:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602294016 00000100:00100000:1.0:1783951645.096480:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602294016 00000100:00100000:1.0:1783951645.096586:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:1.0:1783951645.096598:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:10529:x1870608602294016:12345-192.168.201.6@tcp:58:lfs.0 00000040:00080000:1.0:1783951645.097061:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1783951645.097162:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:10529:x1870608602294016:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 566us (4420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951645.097170:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:2.0:1783951645.100879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951645.100980:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602294272 00000100:00100000:3.0:1783951645.100991:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602294272 00000100:00100000:3.0:1783951645.101060:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1783951645.101071:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d518a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:10530:x1870608602294272:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783951645.101874:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783951645.101984:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1783951645.102033:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.102049:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.102063:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.102071:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.102078:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.102084:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951645.102111:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951645.102212:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d518a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:10530:x1870608602294272:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1141us (1344us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1783951645.102221:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000020:00080000:3.0:1783951645.102227:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783951645.102488:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951645.102500:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.102508:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951645.102512:0:8310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.102520:0:8310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.102535:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:0.0:1783951645.102538:0:8310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783951645.102543:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.102548:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecc66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951645.102566:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951645.102568:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951645.102570:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951645.150286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951645.155844:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602294400 00000100:00100000:1.0:1783951645.155861:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602294400 00000100:00100000:1.0:1783951645.155948:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:1.0:1783951645.155960:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:10532:x1870608602294400:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951645.155991:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951645.156015:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387d3 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156090:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156116:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156129:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156144:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156152:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156158:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156510:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156523:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156532:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156574:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.156588:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 21 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951645.156602:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624323328:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951645.156701:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951645.163972:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624323328:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951645.164015:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951645.164390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951645.164912:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602294656 00000100:00100000:3.0:1783951645.164921:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602294656 00000100:00100000:3.0:1783951645.164994:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1783951645.165004:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:5574:x1870608602294656:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783951645.166561:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:5574:x1870608602294656:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 1549us (2163us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1783951645.166574:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:1.0:1783951645.178760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951645.180033:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602294784 00000100:00100000:2.0:1783951645.180046:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602294784 00010000:00010000:2.0:1783951645.180097:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 23 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951645.180475:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1783951645.180487:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d453e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:2361:x1870608602294784:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951645.180503:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951645.180511:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 23 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.180525:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 23 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.180549:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecb8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038794 expref: 23 pid: 5791 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.180569:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951645.180575:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.180586:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.180593:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951645.180651:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951645.180735:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d453e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:2361:x1870608602294784:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 249us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951645.180751:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00010000:00010000:1.0:1783951645.180856:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.180865:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951645.180927:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783951645.185113:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951645.185179:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185224:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185249:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185257:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185265:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185270:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951645.185274:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185281:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185298:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:1.0:1783951645.185301:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951645.185305:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185311:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eecc74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185328:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185334:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185347:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185352:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951645.185355:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185361:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185370:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8d71d6de00) 00010000:00010000:1.0:1783951645.185372:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951645.185375:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185381:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecc7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185433:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecc6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387d3 expref: 22 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185450:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387d3 expref: 21 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951645.185457:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951645.185460:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951645.185463:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28a00, rc 0) 00000100:00100000:1.0:1783951645.185536:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10532:x1870608602294400:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 29577us (35259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951645.185553:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 129 00010000:00010000:3.0:1783951645.949279:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951646.017515:0:11972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951646.017527:0:11972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951646.017577:0:11972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783951646.017583:0:11972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783951646.134099:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951646.134113:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951646.134167:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783951646.134176:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951646.134323:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b8b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624323456:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951646.134422:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d76d98180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951646.139678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951646.139788:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602294912 00000100:00100000:1.0:1783951646.139798:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602294912 00000100:00100000:1.0:1783951646.139898:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:1.0:1783951646.139910:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10544:x1870608602294912:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783951646.139953:0:5792:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783951646.140086:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10544:x1870608602294912:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 178us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951646.140094:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00080000:2.0:1783951646.140418:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951646.142869:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b8b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624323456:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783951646.148625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951646.148758:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602295168 00000100:00100000:2.0:1783951646.148769:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602295168 00000100:00100000:2.0:1783951646.148856:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:2.0:1783951646.148868:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:10544:x1870608602295168:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951646.148893:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951646.148916:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecc89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387da expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951646.149041:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecc90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951646.149057:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951646.149072:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951646.149100:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783951646.149282:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecc89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387da expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951646.149302:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecc90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387da expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951646.149311:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951646.149314:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951646.149317:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fe00, rc 0) 00000100:00100000:2.0:1783951646.149387:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10544:x1870608602295168:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 521us (773us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1783951646.149397:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:0.0:1783951646.153530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951646.153623:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602295296 00000100:00100000:2.0:1783951646.153635:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602295296 00000100:00100000:2.0:1783951646.153753:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1783951646.153765:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:2360:x1870608602295296:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951646.153784:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951646.153830:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eecc90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387da expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951646.153851:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951646.153856:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951646.153925:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:2360:x1870608602295296:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 161us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951646.153933:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1783951646.157872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951646.158005:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602295552 00000100:00100000:1.0:1783951646.158016:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602295552 00000100:00100000:1.0:1783951646.158077:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 132 00000100:00100000:1.0:1783951646.158086:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:10544:x1870608602295552:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783951646.158167:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158183:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158194:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158424:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158432:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158529:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158535:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951646.158540:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158548:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158561:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:1.0:1783951646.158564:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951646.158568:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951646.158574:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecc9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951646.158741:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10544:x1870608602295552:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 654us (880us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1783951646.158750:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 132 00000040:00080000:1.0:1783951646.158905:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951646.158911:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951646.161060:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783951646.161082:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783951646.166953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951646.167005:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602295808 00000100:00100000:1.0:1783951646.167015:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602295808 00000100:00100000:1.0:1783951646.169040:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1783951646.169069:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:10544:x1870608602295808:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783951646.169371:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:10544:x1870608602295808:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 307us (2429us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1783951646.169379:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00010000:00010000:3.0:1783951646.966183:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951647.100913:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951647.101008:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951647.101503:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624323584 00000100:00100000:1.0:1783951647.101513:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624323584 00000100:00100000:1.0:1783951647.101581:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783951647.101594:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624323584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951647.101635:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951647.101695:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624323584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951647.101704:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1783951647.101873:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951647.101929:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624323584:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783951647.902415:0:12023:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951647.902429:0:12023:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951647.902480:0:12023:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783951647.902486:0:12023:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783951647.992688:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951648.083501:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951648.083555:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602296064 00000100:00100000:2.0:1783951648.083568:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602296064 00000100:00100000:2.0:1783951648.083679:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:2.0:1783951648.083701:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:10564:x1870608602296064:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951648.083730:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951648.083754:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387e1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951648.083901:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eeccac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951648.083918:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eeccac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951648.083932:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eeccac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951648.083950:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783951648.084060:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387e1 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951648.084091:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eeccac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387e1 expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951648.084098:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:2.0:1783951648.084101:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783951648.084103:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fe00, rc 0) 00000100:00100000:2.0:1783951648.084160:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:10564:x1870608602296064:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 472us (667us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1783951648.084166:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00080000:3.0:1783951648.085555:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951648.088497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951648.088540:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602296192 00000100:00100000:1.0:1783951648.088548:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602296192 00000100:00100000:3.0:1783951648.088611:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:3.0:1783951648.088622:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:10564:x1870608602296192:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1783951648.088692:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088709:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088721:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088755:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088762:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088770:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088776:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951648.088779:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088784:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088793:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:3.0:1783951648.088983:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951648.088989:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951648.088994:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eeccba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951648.089057:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:10564:x1870608602296192:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 437us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951648.089066:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:1.0:1783951648.118079:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624323968:0@lo:400:kworker.0 00000100:00100000:2.0:1783951648.118146:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624324096:0@lo:400:kworker.0 00000100:00100000:1.0:1783951648.118159:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951648.118181:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951648.118229:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783951648.118236:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624323840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951648.118259:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951648.118276:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624324352:0@lo:400:kworker.0 00000100:00100000:1.0:1783951648.118296:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951648.118326:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624323968 00000100:00100000:0.0:1783951648.118331:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624324096 00000100:00100000:1.0:1783951648.118334:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624323968 00000100:00100000:0.0:1783951648.118336:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624324096 00000100:00100000:1.0:1783951648.118375:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624323840 00000100:00100000:0.0:1783951648.118375:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624324352 00000100:00100000:0.0:1783951648.118377:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624324352 00000100:00100000:1.0:1783951648.118390:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624323840 00000100:00100000:1.0:1783951648.118411:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783951648.118411:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783951648.118418:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624323968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951648.118429:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624324096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951648.118467:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624323968:12345-0@lo:400:kworker.0 Request processed in 50us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951648.118467:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624324096:12345-0@lo:400:kworker.0 Request processed in 49us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951648.118475:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783951648.118475:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783951648.118492:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783951648.118492:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783951648.118498:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624323840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951648.118498:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1870608624324352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951648.118522:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624323840:12345-0@lo:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951648.118522:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1870608624324352:12345-0@lo:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951648.118529:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783951648.118529:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783951648.118568:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624323840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951648.118580:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624324352:0@lo:400:kworker.0 00000100:00100000:1.0:1783951648.118587:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624323968:0@lo:400:kworker.0 00000100:00100000:3.0:1783951648.119029:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624323712:0@lo:400:kworker.0 00000100:00100000:3.0:1783951648.119072:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951648.119110:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8119b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624324224:0@lo:400:kworker.0 00000100:00100000:3.0:1783951648.119133:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783951648.119171:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951648.119176:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951648.119186:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624324224 00000100:00100000:3.0:1783951648.119199:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624324224 00000100:00100000:3.0:1783951648.119236:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783951648.119242:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624324224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951648.119278:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624324224:12345-0@lo:400:kworker.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951648.119285:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1783951648.119300:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951648.119320:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8119b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624324224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951648.119639:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624323712 00000100:00100000:0.0:1783951648.119644:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624323712 00000100:00100000:0.0:1783951648.119681:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783951648.119688:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624323712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951648.119733:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624323712:12345-0@lo:400:kworker.0 Request processed in 46us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951648.119740:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783951648.119873:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624323712:0@lo:400:kworker.0 00000100:00100000:2.0:1783951648.120275:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624324096:0@lo:400:kworker.0 00000001:00080000:2.0:1783951648.157735:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1783951648.157754:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1783951648.157764:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:1.0:1783951648.212609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951648.214853:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602296320 00000100:00100000:0.0:1783951648.214878:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602296320 00000100:00080000:3.0:1783951648.214975:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951648.215547:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:0.0:1783951648.215561:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602296320:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1783951648.215582:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951648.216446:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019581eb0/0x443dabd358eeccc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387e8 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951648.216484:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a54f11c, atime: 0x6a54f11b, ctime: 0x6a54f11c, blocks: 0xb 00010000:00010000:1.0:1783951648.216507:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1783951648.216511:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951648.216525:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019581eb0/0x443dabd358eeccc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387e8 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951648.216547:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019581eb0/0x443dabd358eeccc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387e8 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951648.216576:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29000, rc 0) 00000100:00100000:1.0:1783951648.216660:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602296320:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1102us (4060us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951648.216669:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1783951648.222171:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951648.222412:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602296448 00000100:00100000:0.0:1783951648.222423:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602296448 00002000:00100000:0.0:1783951648.222476:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8e8d8119b100 x1870608602296448/t0(0) o3->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:664/0 lens 488/0 e 0 to 0 dl 1783951659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783951648.222507:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d8119b100 with x1870608602296448 ext(0->4095) 00002000:00010000:0.0:1783951648.222515:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d8119b100 00000100:00100000:0.0:1783951648.222559:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1783951648.222569:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602296448:12345-192.168.201.6@tcp:3:cat.0 00000100:00100000:1.0:1783951648.228015:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602296448:12345-192.168.201.6@tcp:3:cat.0 Request processed in 5433us (5840us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783951648.228034:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00002000:00100000:1.0:1783951648.228053:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8e8d8119b100 x1870608602296448/t0(0) o3->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:664/0 lens 488/4536 e 0 to 0 dl 1783951659 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951648.228066:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d8119b100 with x1870608602296448 ext(0->4095) 00002000:00010000:1.0:1783951648.228074:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d8119b100 00000100:00100000:3.0:1783951648.630206:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951648.630233:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624324480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951648.630308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951648.630479:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624324480 00000100:00100000:1.0:1783951648.630487:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624324480 00000100:00100000:1.0:1783951648.630539:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783951648.630549:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624324480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951648.630592:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951648.630645:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624324480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951648.630652:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783951648.630737:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1783951648.630743:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1783951648.630764:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d759a2a00, transno 4294967304 00000100:00100000:0.0:1783951648.630788:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624324480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783951649.013922:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951649.109353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951649.109414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951649.109458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951649.109488:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951649.109516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951649.109557:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602297088 00000100:00100000:2.0:1783951649.109567:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602297088 00000100:00100000:2.0:1783951649.109630:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602296704 00000100:00100000:2.0:1783951649.109634:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602296704 00000100:00100000:2.0:1783951649.109659:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:2.0:1783951649.109669:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602297088:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951649.109961:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602297088:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 291us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951649.109970:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:2.0:1783951649.109991:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:2.0:1783951649.109998:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:2360:x1870608602296704:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951649.110021:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:2360:x1870608602296704:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951649.110028:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:2.0:1783951649.110055:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602296832 00000100:00100000:2.0:1783951649.110059:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602296832 00000100:00100000:2.0:1783951649.110085:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602296960 00000100:00100000:2.0:1783951649.110088:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602296960 00000100:00100000:2.0:1783951649.110113:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:2.0:1783951649.110119:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2360:x1870608602296832:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951649.110250:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1783951649.110260:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602296960:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951649.110293:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602296960:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951649.110300:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:2.0:1783951649.110426:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2360:x1870608602296832:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 306us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951649.110434:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00080000:2.0:1783951649.110512:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951649.110518:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951649.110911:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602296576 00000100:00100000:3.0:1783951649.110920:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602296576 00000100:00100000:3.0:1783951649.115354:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 285 00000100:00100000:3.0:1783951649.115389:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602296576:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951649.115617:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602296576:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 246us (6278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951649.115627:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 285 00010000:00010000:3.0:1783951650.038540:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783951650.272096:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:1.0:1783951650.272125:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1783951650.272162:0:5813:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8d48198780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1783951650.272167:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d7f7a3c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d74eca600 00000020:00080000:1.0:1783951650.272182:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d7f7a3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d79dbe400 00000020:00080000:1.0:1783951650.272196:0:5813:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1783951650.272323:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1783951650.272564:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1783951650.304246:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1783951650.304264:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1783951651.066115:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951651.326712:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951651.326725:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951651.327108:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1783951651.327115:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783951652.086842:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951652.214267:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951652.214352:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951652.214398:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624324608 00000100:00100000:1.0:1783951652.214408:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624324608 00000100:00100000:1.0:1783951652.214518:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783951652.214530:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624324608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951652.214576:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951652.214630:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624324608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951652.214638:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951652.214672:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1783951652.214679:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d759a1500, transno 4294967311 00000100:00080000:3.0:1783951652.214692:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1783951652.214697:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1783951652.214733:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624324608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783951653.111245:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951653.239290:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624324736:0@lo:400:kworker.0 00000100:00100000:2.0:1783951653.239377:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951653.239422:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624325248:0@lo:400:kworker.0 00000100:00100000:2.0:1783951653.239448:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951653.239476:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951653.239482:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624325120:0@lo:400:kworker.0 00000100:00100000:2.0:1783951653.239511:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951653.239545:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624325248 00000100:00100000:2.0:1783951653.239553:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624325248 00000100:00100000:2.0:1783951653.239608:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783951653.239618:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624325248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951653.239669:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624325248:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951653.239677:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783951653.239722:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624325248:0@lo:400:kworker.0 00000100:00100000:1.0:1783951653.239800:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624324736 00000100:00100000:1.0:1783951653.239805:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624324736 00000100:00100000:1.0:1783951653.239867:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783951653.239874:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624324736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951653.239910:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624324736:12345-0@lo:400:kworker.0 Request processed in 37us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951653.239917:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783951653.239960:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624324736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951653.240533:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624325120 00000100:00100000:0.0:1783951653.240539:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624325120 00000100:00100000:0.0:1783951653.240580:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783951653.240588:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624325120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951653.240645:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624325120:12345-0@lo:400:kworker.0 Request processed in 59us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951653.240652:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783951653.241210:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624325120:0@lo:400:kworker.0 00000100:00100000:3.0:1783951653.241341:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624324864:0@lo:400:kworker.0 00000100:00100000:3.0:1783951653.241385:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951653.241409:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624325376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951653.241431:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951653.241461:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951653.241468:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624324992:0@lo:400:kworker.0 00000100:00100000:3.0:1783951653.241492:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783951653.241522:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951653.241539:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624324864 00000100:00100000:3.0:1783951653.241543:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624324864 00000100:00100000:3.0:1783951653.241574:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624324992 00000100:00100000:3.0:1783951653.241578:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624324992 00000100:00100000:3.0:1783951653.241604:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783951653.241620:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624324864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951653.241657:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624324864:12345-0@lo:400:kworker.0 Request processed in 39us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951653.241663:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783951653.241678:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783951653.241683:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624324992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951653.241707:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624324992:12345-0@lo:400:kworker.0 Request processed in 24us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951653.241712:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1783951653.241725:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951653.241741:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624324992:0@lo:400:kworker.0 00000100:00100000:3.0:1783951653.241750:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624324864:0@lo:400:kworker.0 00000100:00100000:1.0:1783951653.241835:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624325376 00000100:00100000:1.0:1783951653.241839:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624325376 00000100:00100000:1.0:1783951653.241882:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783951653.241889:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624325376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951653.241926:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624325376:12345-0@lo:400:kworker.0 Request processed in 38us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951653.241954:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1783951653.242082:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951653.242110:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624325376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951653.753307:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624325504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951653.753393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951653.753525:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624325504 00000100:00100000:2.0:1783951653.753533:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624325504 00000100:00100000:2.0:1783951653.753620:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951653.753631:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624325504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951653.753674:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951653.759284:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624325504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5642us (5878us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951653.759300:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783951653.763404:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624325504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783951654.135548:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951654.212076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951654.212240:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602297216 00000100:00100000:3.0:1783951654.212250:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602297216 00000100:00100000:3.0:1783951654.212326:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:3.0:1783951654.212335:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:10209:x1870608602297216:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783951654.212450:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:10209:x1870608602297216:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 Request processed in 116us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951654.212473:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00080000:0.0:1783951654.212841:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951654.218054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951654.218233:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602297472 00000100:00100000:2.0:1783951654.218260:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602297472 00000100:00100000:2.0:1783951654.218328:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:2.0:1783951654.218339:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:10209:x1870608602297472:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783951654.219004:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:10209:x1870608602297472:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 664us (971us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1783951654.219013:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1783951654.235279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951654.235322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951654.235415:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602297600 00000100:00100000:3.0:1783951654.235427:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602297600 00000100:00100000:3.0:1783951654.235498:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 287 00000100:00100000:3.0:1783951654.235509:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2358:x1870608602297600:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951654.235605:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2358:x1870608602297600:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 96us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951654.235613:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 287 00000100:00100000:1.0:1783951654.236779:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951654.243521:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951654.243620:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602297984 00000100:00100000:3.0:1783951654.243630:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602297984 00000100:00100000:3.0:1783951654.243706:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:3.0:1783951654.243715:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602297984:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951654.243792:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602297984:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951654.243800:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00080000:1.0:1783951654.244301:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951654.244749:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602297856 00000100:00100000:0.0:1783951654.244756:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602297856 00000100:00100000:0.0:1783951654.244823:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602297728 00000100:00100000:0.0:1783951654.244827:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602297728 00000100:00100000:0.0:1783951654.244850:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:0.0:1783951654.244857:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602297856:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951654.244895:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2358:x1870608602297856:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 38us (9572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951654.244901:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:0.0:1783951654.244912:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:0.0:1783951654.244918:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602297728:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951654.244937:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602297728:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 20us (8164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951654.244943:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00080000:1.0:1783951654.245369:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951654.245383:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951654.617736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951654.617840:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602298112 00000100:00100000:3.0:1783951654.617914:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602298112 00000100:00100000:3.0:1783951654.618033:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:3.0:1783951654.618045:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:11018:x1870608602298112:12345-192.168.201.6@tcp:101:lsof.0 00010000:00010000:3.0:1783951654.618066:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951654.618117:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eeccc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387ef expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951654.618187:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951654.618218:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951654.618230:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951654.619605:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783951654.619614:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951654.619735:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951654.619771:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eeccc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951654.619791:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951654.619801:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:3.0:1783951654.619804:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951654.621117:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8600, rc 0) 00000100:00100000:3.0:1783951654.621213:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+6:11018:x1870608602298112:12345-192.168.201.6@tcp:101:lsof.0 Request processed in 3167us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951654.621223:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 136 00010000:00010000:3.0:1783951655.160187:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783951655.393588:0:5813:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1783951655.393620:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1783951655.393782:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1783951655.393793:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1783951656.182109:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951657.206054:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951657.340162:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951657.340189:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624325632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951657.340273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951657.340674:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624325632 00000100:00100000:0.0:1783951657.340683:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624325632 00000100:00100000:0.0:1783951657.340761:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783951657.340774:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624325632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951657.340859:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951657.340944:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624325632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951657.340952:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1783951657.341011:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951657.341141:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624325632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783951658.230363:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951658.358392:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624325888:0@lo:400:kworker.0 00000100:00100000:1.0:1783951658.358470:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951658.358513:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624326144:0@lo:400:kworker.0 00000100:00100000:2.0:1783951658.358547:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951658.358583:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624326144 00000100:00100000:2.0:1783951658.358590:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624326144 00000100:00100000:1.0:1783951658.358612:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c4371d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624326400:0@lo:400:kworker.0 00000100:00100000:2.0:1783951658.358637:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783951658.358637:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951658.358647:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624326144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951658.358659:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951658.358664:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624326016:0@lo:400:kworker.0 00000100:00100000:1.0:1783951658.358685:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951658.358694:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624326144:12345-0@lo:400:kworker.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951658.358702:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783951658.358717:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624326400 00000100:00100000:1.0:1783951658.358717:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624325888 00000100:00100000:2.0:1783951658.358720:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624326400 00000100:00100000:1.0:1783951658.358720:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624325888 00000100:00100000:1.0:1783951658.358746:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624326016 00000100:00100000:2.0:1783951658.358747:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783951658.358748:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624326016 00000100:00100000:2.0:1783951658.358752:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624326400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951658.358769:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783951658.358775:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624325888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951658.358784:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624326400:12345-0@lo:400:kworker.0 Request processed in 32us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951658.358790:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783951658.358803:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624325888:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951658.358837:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1783951658.358839:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951658.358844:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951658.358850:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783951658.358856:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624326016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951658.358885:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624326016:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951658.358891:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783951658.358983:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624325760:0@lo:400:kworker.0 00000100:00100000:3.0:1783951658.359032:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951658.359062:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c4371ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624326272:0@lo:400:kworker.0 00000100:00100000:3.0:1783951658.359083:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951658.359147:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624326272 00000100:00100000:2.0:1783951658.359152:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624326272 00000100:00100000:3.0:1783951658.359158:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624326144:0@lo:400:kworker.0 00000100:00100000:2.0:1783951658.359179:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783951658.359191:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624326272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951658.359193:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624326016:0@lo:400:kworker.0 00000100:00100000:3.0:1783951658.359202:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624325888:0@lo:400:kworker.0 00000100:00100000:3.0:1783951658.359209:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c4371d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624326400:0@lo:400:kworker.0 00000100:00100000:2.0:1783951658.359228:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624326272:12345-0@lo:400:kworker.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951658.359233:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783951658.359573:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624325760 00000100:00100000:1.0:1783951658.359578:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624325760 00000100:00100000:1.0:1783951658.359606:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1783951658.359611:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624325760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951658.359645:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624325760:12345-0@lo:400:kworker.0 Request processed in 34us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951658.359650:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:3.0:1783951658.359704:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951658.370751:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624325760:0@lo:400:kworker.0 00000100:00100000:2.0:1783951658.370777:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c4371ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624326272:0@lo:400:kworker.0 00000001:02000400:3.0:1783951658.770336:0:12227:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:07:37 (1783951657) 00000100:00100000:0.0:1783951658.874239:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951658.874263:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c4371f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624326528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951658.874341:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951658.875026:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624326528 00000100:00100000:1.0:1783951658.875034:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624326528 00000100:00100000:1.0:1783951658.875094:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783951658.875105:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624326528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951658.875147:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951658.875204:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624326528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951658.875212:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783951658.875280:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c4371f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624326528:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783951659.254036:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951659.354348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951659.354417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951659.354466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951659.354649:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602298240 00000100:00100000:0.0:1783951659.354658:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602298240 00000100:00100000:0.0:1783951659.354699:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 289 00000100:00100000:0.0:1783951659.354707:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602298240:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951659.354767:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2359:x1870608602298240:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 62us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951659.354773:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 289 00000100:00100000:3.0:1783951659.354864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951659.355077:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602298624 00000100:00100000:0.0:1783951659.355081:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602298624 00000100:00100000:0.0:1783951659.355117:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602298496 00000100:00100000:0.0:1783951659.355121:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602298496 00000100:00100000:0.0:1783951659.355141:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:0.0:1783951659.355148:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602298624:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951659.355186:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602298624:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 38us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951659.355192:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:0.0:1783951659.355204:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:0.0:1783951659.355210:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602298496:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951659.355235:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602298496:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951659.355261:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00080000:0.0:1783951659.355291:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951659.355295:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951659.355427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951659.364098:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602298368 00000100:00100000:0.0:1783951659.364118:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602298368 00000100:00100000:1.0:1783951659.364268:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602298752 00000100:00100000:1.0:1783951659.364273:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602298752 00000100:00100000:0.0:1783951659.366196:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:0.0:1783951659.366228:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:2359:x1870608602298368:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951659.366327:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:2359:x1870608602298368:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 105us (11989us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951659.366335:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00080000:3.0:1783951659.370982:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951659.377394:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:2.0:1783951659.377425:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+6:2359:x1870608602298752:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951659.378069:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+6:2359:x1870608602298752:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 650us (22639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951659.378078:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:3.0:1783951660.003160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951660.003370:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602299008 00000100:00100000:0.0:1783951660.003382:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602299008 00000100:00100000:0.0:1783951660.003470:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:0.0:1783951660.003482:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:11283:x1870608602299008:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951660.003506:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951660.003531:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eeccd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387f6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.003613:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.003629:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.003641:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.003656:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.003672:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.003679:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004263:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecceb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004276:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecceb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004283:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecceb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951660.004292:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783951660.004500:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004508:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004515:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004521:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951660.004526:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004533:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004557:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8d821cf800) 00010000:00010000:0.0:1783951660.004560:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951660.004565:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004572:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eeccdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004585:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004592:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004598:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004603:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951660.004605:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004612:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004619:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8d452ae300) 00010000:00010000:0.0:1783951660.004621:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951660.004624:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.004630:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecce4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.005113:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eeccd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387f6 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.005131:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecceb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387f6 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951660.005139:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:0.0:1783951660.005141:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951660.005144:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4600, rc 0) 00000100:00100000:0.0:1783951660.005239:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:11283:x1870608602299008:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1758us (2091us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1783951660.005249:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:1.0:1783951660.013413:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951660.013532:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602299136 00000100:00100000:2.0:1783951660.013544:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602299136 00000100:00100000:2.0:1783951660.013618:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:2.0:1783951660.013629:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:2359:x1870608602299136:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951660.013647:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951660.013691:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecceb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387f6 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951660.013710:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:2.0:1783951660.013716:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951660.013780:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:2359:x1870608602299136:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 152us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951660.013932:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1783951660.020368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951660.020476:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602299264 00000100:00100000:2.0:1783951660.020497:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602299264 00000100:00100000:2.0:1783951660.020558:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:2.0:1783951660.020569:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:11283:x1870608602299264:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783951660.020717:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:11283:x1870608602299264:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 149us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951660.020725:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 138 00010000:00010000:3.0:1783951660.277975:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783951660.468001:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:2.0:1783951660.536358:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951660.536368:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951660.538038:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783951660.538056:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783951661.302032:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951661.558563:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951661.558573:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951661.559033:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1783951661.559040:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783951662.168654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951662.168759:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602299392 00000100:00100000:0.0:1783951662.168770:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602299392 00000100:00080000:2.0:1783951662.168928:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951662.169388:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:0.0:1783951662.169402:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:11326:x1870608602299392:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951662.169426:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951662.169449:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eeccf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0387fd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169520:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169535:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169562:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169576:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169582:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169586:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169918:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169924:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169928:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169933:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951662.169936:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169941:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169961:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:0.0:1783951662.169964:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951662.169969:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169986:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.169999:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170005:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170012:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170018:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951662.170022:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170028:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170035:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8d452aeb00) 00010000:00010000:0.0:1783951662.170038:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951662.170041:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170047:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170082:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eeccf9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387fd expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170104:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:0.0:1783951662.170106:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951662.170110:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5e00/0x443dabd358eeccf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387fd expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.170120:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5e00, rc 0) 00000100:00100000:0.0:1783951662.170201:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:11326:x1870608602299392:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 803us (1556us total) trans 0 rc 301/301 00000100:00100000:0.0:1783951662.170211:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:1.0:1783951662.185000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951662.185211:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602299648 00000100:00100000:2.0:1783951662.185223:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602299648 00000100:00100000:2.0:1783951662.185298:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:2.0:1783951662.185311:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:11326:x1870608602299648:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:2.0:1783951662.185372:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951662.185396:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eec677 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038636 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.185411:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:2.0:1783951662.185414:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951662.185653:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.185668:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 5 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.185675:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.185714:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 5 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.185724:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 5 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951662.185738:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624326656:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951662.185874:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951662.191338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951662.191387:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602299776 00000100:00100000:3.0:1783951662.191397:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602299776 00010000:00010000:3.0:1783951662.191453:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 6 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951662.191465:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624326656:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951662.191492:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951662.191506:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1783951662.191516:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5168f61-b22b-4094-aa34-e52db03426e1+6:2358:x1870608602299776:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951662.191532:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951662.191540:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 6 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.191552:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 6 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783951662.191560:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951662.191576:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecccf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387ef expref: 6 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.191593:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:3.0:1783951662.191598:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.191607:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.191614:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.191643:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951662.191700:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2358:x1870608602299776:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 184us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951662.191707:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00010000:00010000:1.0:1783951662.191723:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.191730:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.191756:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.191764:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.191769:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951662.192754:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783951662.192765:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.192771:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.192776:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.192780:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951662.192783:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.192796:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.192805:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:1.0:1783951662.192807:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951662.192834:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.192840:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecd0e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951662.192857:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2a4d287 reply state 0000000010eba122 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951662.192864:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951662.192920:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:11326:x1870608602299648:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 7611us (7931us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1783951662.192926:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 140 00010000:00010000:2.0:1783951662.196930:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.196955:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.196963:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.196969:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951662.196974:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.197000:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.197019:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8d71d6d000) 00010000:00010000:2.0:1783951662.197022:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951662.197026:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.197031:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecd15 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951662.312242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951662.312291:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602299904 00000100:00100000:3.0:1783951662.312315:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602299904 00000100:00100000:3.0:1783951662.312443:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:3.0:1783951662.312465:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:11334:x1870608602299904:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:3.0:1783951662.312496:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951662.312525:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecd1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038804 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.312595:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecd23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.312609:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecd23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.312622:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecd23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951662.312702:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783951662.312707:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951662.312753:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecd23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.314125:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecd1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038804 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.314154:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecd23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038804 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.314164:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:3.0:1783951662.314167:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951662.314171:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8000, rc 0) 00000100:00100000:3.0:1783951662.314268:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:11334:x1870608602299904:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 1805us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951662.314278:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 141 00010000:00010000:3.0:1783951662.326198:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951662.419072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951662.421080:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602300032 00000100:00100000:1.0:1783951662.421093:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602300032 00000100:00100000:1.0:1783951662.421177:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:1.0:1783951662.421191:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:11340:x1870608602300032:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951662.421216:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951662.421242:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eecd2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03880b expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421330:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421366:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421379:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421396:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421405:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421412:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421540:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecd3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421549:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421557:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951662.421591:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783951662.421596:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951662.421620:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421632:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421650:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421657:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421663:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951662.421668:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421676:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421688:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:1.0:1783951662.421692:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951662.421697:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421704:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecd31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421720:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421727:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421734:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421739:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951662.421748:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421755:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421763:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951662.421765:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951662.421768:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421774:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecd38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421804:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eecd2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03880b expref: 16 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421879:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecd3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03880b expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.421887:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:1.0:1783951662.421890:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783951662.421893:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29400, rc 0) 00000100:00100000:1.0:1783951662.421983:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:11340:x1870608602300032:12345-192.168.201.6@tcp:101:bash.0 Request processed in 795us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951662.421991:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:2.0:1783951662.424752:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951662.424959:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602300288 00000100:00100000:0.0:1783951662.424970:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602300288 00000100:00100000:0.0:1783951662.425044:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:0.0:1783951662.425055:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+15:11340:x1870608602300288:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1783951662.425078:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951662.425106:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038812 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.425264:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.425281:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.425293:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.425348:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.425372:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.425379:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951662.426095:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1783951662.426275:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426286:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426295:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426333:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426340:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426348:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426356:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951662.426361:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426368:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426392:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:0.0:1783951662.426395:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951662.426400:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426407:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecd4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951662.426420:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2de559d reply state 00000000084faf3c transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951662.426429:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783951662.426459:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eecd46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426475:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.426482:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d452ae300) 00010000:00010000:0.0:1783951662.426485:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951662.426487:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4600, rc 0) 00000100:00100000:0.0:1783951662.427094:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11340:x1870608602300288:12345-192.168.201.6@tcp:101:bash.0 Request processed in 2038us (2349us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783951662.427103:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:0.0:1783951662.438418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951662.438539:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602300416 00000100:00100000:2.0:1783951662.438550:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602300416 00000100:00100000:2.0:1783951662.438623:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:2.0:1783951662.438635:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602300416:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951662.438655:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951662.438679:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038819 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951662.438724:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951662.438743:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1783951662.438748:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951662.438760:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.438780:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.438833:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:2.0:1783951662.438890:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602300416:12345-192.168.201.6@tcp:101:bash.0 Request processed in 258us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951662.438896:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00080000:0.0:1783951662.439842:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783951662.440097:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.440109:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.440118:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.440125:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951662.440130:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.440138:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.440156:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d452aeb00) 00010000:00010000:3.0:1783951662.440159:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951662.440164:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.440171:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecd54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951662.455572:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c4371ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624326784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951662.455655:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951662.456936:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624326784 00000100:00100000:1.0:1783951662.456960:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624326784 00000100:00100000:1.0:1783951662.457056:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783951662.457070:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624326784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951662.457135:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951662.457206:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624326784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951662.457214:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1783951662.457377:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951662.457875:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c4371ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624326784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951662.458394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951662.458478:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602300544 00000100:00100000:2.0:1783951662.458484:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602300544 00000100:00100000:2.0:1783951662.458538:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1783951662.458547:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:11340:x1870608602300544:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951662.458561:0:8067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951662.458579:0:8067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038820 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.458611:0:8067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.458619:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951662.458623:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951662.458629:0:8067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 7 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.458663:0:8067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.458676:0:8067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 7 pid: 6589 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951662.458768:0:8067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8067:1870608624326912:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951662.458860:0:8067:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951662.467401:0:8067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8067:1870608624326912:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951662.467481:0:8067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 7 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.467504:0:8067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f000, rc 0) 00000100:00100000:0.0:1783951662.467580:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:11340:x1870608602300544:12345-192.168.201.6@tcp:101:bash.0 Request processed in 9033us (9187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951662.467590:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:0.0:1783951662.468771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951662.472032:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602300672 00000100:00100000:2.0:1783951662.472047:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602300672 00010000:00010000:2.0:1783951662.472108:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 7 pid: 6589 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951662.472165:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1783951662.472177:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602300672:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951662.472198:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951662.472222:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 7 pid: 6589 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.472237:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 7 pid: 6589 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.472264:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000828f8f5f/0x443dabd358eecd69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038819 expref: 7 pid: 6589 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.472284:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951662.472289:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951662.472298:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 6 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.472719:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 6 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.472771:0:5776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 6 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951662.472788:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bf2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5776:1870608624327040:192.168.201.6@tcp:105: 00000100:00100000:2.0:1783951662.472993:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951662.479868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951662.482035:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602300928 00000100:00100000:1.0:1783951662.482050:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602300928 00000100:00100000:1.0:1783951662.482136:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:1.0:1783951662.482147:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11340:x1870608602300928:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:1.0:1783951662.482544:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11340:x1870608602300928:12345-192.168.201.6@tcp:35:bash.0 Request processed in 398us (2688us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1783951662.482554:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:2.0:1783951662.483096:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bf2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5776:1870608624327040:192.168.201.6@tcp:105: 00010000:00010000:2.0:1783951662.483122:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951662.483191:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602300672:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 11017us (14425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951662.483201:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1783951662.607899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951662.607972:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602301184 00000100:00100000:1.0:1783951662.607982:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602301184 00000100:00100000:1.0:1783951662.608049:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:1.0:1783951662.608061:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11350:x1870608602301184:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951662.608091:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951662.608114:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eecd77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038827 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951662.608246:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783951662.608378:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eecd77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038827 expref: 20 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.608394:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:1.0:1783951662.608397:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951662.608416:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eecd77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038827 expref: 20 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.608431:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29600, rc 0) 00000100:00100000:1.0:1783951662.608619:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:11350:x1870608602301184:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 559us (729us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1783951662.608628:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:0.0:1783951662.623384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951662.625044:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602301440 00000100:00100000:1.0:1783951662.625058:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602301440 00000100:00100000:1.0:1783951662.625202:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:1.0:1783951662.625213:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:11350:x1870608602301440:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951662.625661:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11350:x1870608602301440:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 449us (2286us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783951662.625671:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:0.0:1783951662.733285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951662.733697:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602301568 00000100:00100000:3.0:1783951662.733758:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602301568 00000100:00100000:3.0:1783951662.734302:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 145 00000100:00100000:3.0:1783951662.734313:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11356:x1870608602301568:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951662.734340:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951662.734361:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecd85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03882e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.734427:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecd8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.734452:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.734464:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951662.734688:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1783951662.734693:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951662.734729:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.734766:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecd85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03882e expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.734793:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecd8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03882e expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.734803:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951662.735034:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951662.735039:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8400, rc 0) 00000100:00100000:3.0:1783951662.735102:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:11356:x1870608602301568:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 791us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951662.735110:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 145 00000100:00100000:0.0:1783951662.743285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951662.743385:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602301824 00000100:00100000:2.0:1783951662.743394:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602301824 00000100:00100000:2.0:1783951662.743459:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 146 00000100:00100000:2.0:1783951662.743470:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:11356:x1870608602301824:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951662.743492:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951662.743515:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecd93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038835 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.743644:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecd9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.743660:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecd9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.743687:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecd9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951662.743700:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783951662.743900:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecd93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038835 expref: 24 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.743923:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecd9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038835 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.743931:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d452ae300) 00010000:00010000:2.0:1783951662.743935:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951662.743947:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f400, rc 0) 00000100:00100000:2.0:1783951662.744009:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:11356:x1870608602301824:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 540us (735us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1783951662.744016:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 146 00000100:00100000:2.0:1783951662.753257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951662.753504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951662.754445:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602302208 00000100:00100000:1.0:1783951662.754457:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602302208 00000100:00100000:1.0:1783951662.754527:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 147 00000100:00100000:1.0:1783951662.754538:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:11356:x1870608602302208:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951662.754565:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951662.754587:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eecda8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03883c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.754701:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecdaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.754717:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecdaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.754750:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecdaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951662.754765:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783951662.754954:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eecda8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03883c expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.754975:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecdaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03883c expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.754983:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d452ae300) 00010000:00010000:1.0:1783951662.754986:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783951662.754990:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28200, rc 0) 00000100:00100000:1.0:1783951662.755058:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:11356:x1870608602302208:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 522us (1553us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783951662.755066:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 147 00000100:00100000:0.0:1783951662.758553:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602301952 00000100:00100000:0.0:1783951662.758577:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602301952 00000100:00100000:0.0:1783951662.758654:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1783951662.758665:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:2361:x1870608602301952:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951662.758682:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951662.758711:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecd9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038835 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.758730:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d452ae300) 00010000:00010000:0.0:1783951662.758735:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951662.758853:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:2361:x1870608602301952:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 189us (5606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951662.758861:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1783951662.774734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951662.775038:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602302336 00000100:00100000:0.0:1783951662.775048:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602302336 00000100:00100000:0.0:1783951662.775155:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1783951662.775168:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602302336:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:0.0:1783951662.775214:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.775261:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 6 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.775271:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951662.775276:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951662.775281:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.775344:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 6 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.775359:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 6 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951662.775375:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1870608624327168:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951662.775593:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951662.779103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951662.780140:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1870608624327168:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951662.780204:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951662.780376:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602302464 00000100:00100000:3.0:1783951662.780385:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602302464 00002000:00100000:3.0:1783951662.780464:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e8d79bde300 x1870608602302464/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:678/0 lens 504/0 e 0 to 0 dl 1783951673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951662.780474:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d79bde300 with x1870608602302464 ext(0->12) 00010000:00010000:3.0:1783951662.780801:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 7 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.780843:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 7 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951662.781162:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8d79bde300 00000100:00100000:3.0:1783951662.781213:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1783951662.781243:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602302464:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:3.0:1783951662.783254:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2359:x1870608602302464:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 2024us (4219us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783951662.783265:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00002000:00100000:3.0:1783951662.783276:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e8d79bde300 x1870608602302464/t4294967305(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:678/0 lens 504/448 e 0 to 0 dl 1783951673 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951662.783285:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d79bde300 with x1870608602302464 ext(0->12) 00010000:00010000:3.0:1783951662.783295:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 9 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.783337:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 9 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951662.783356:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8d79bde300 00000100:00100000:2.0:1783951662.789383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951662.789580:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602302592 00000100:00100000:3.0:1783951662.789589:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602302592 00010000:00010000:3.0:1783951662.789636:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 9 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951662.789674:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:3.0:1783951662.789683:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2358:x1870608602302592:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951662.789700:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783951662.789727:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783951662.789731:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783951662 00002000:00010000:3.0:1783951662.789733:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783951663 00002000:00010000:3.0:1783951662.789736:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783951662 00010000:00010000:3.0:1783951662.789742:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 9 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.789756:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 9 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.789785:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e79e6f8/0x443dabd358eecd70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038820 expref: 9 pid: 8067 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.789875:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951662.789879:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951662.789886:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.789896:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.789925:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951662.789998:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602302592:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 315us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951662.790006:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00010000:00010000:0.0:1783951662.790870:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.790897:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.790926:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.790935:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.790954:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.790962:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5a00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951662.790966:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.790975:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.790989:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.790995:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000310baf63/0x443dabd358eecdbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951662.791080:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2360:x1870608602302336:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 15915us (16357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951662.791089:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:2.0:1783951662.798170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951662.798326:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602302848 00000100:00100000:3.0:1783951662.798337:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602302848 00000100:00100000:3.0:1783951662.798464:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1783951662.798478:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d518aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:11356:x1870608602302848:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:3.0:1783951662.798559:0:5795:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecdaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03883c expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951662.799340:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1783951662.799412:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1783951662.800764:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1783951662.801113:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.801135:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.801153:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.801198:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.801213:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 28 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951662.801229:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5795:1870608624327296:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951662.801329:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951662.807806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951662.808181:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5795:1870608624327296:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951662.808212:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951662.808348:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602302976 00000100:00100000:3.0:1783951662.808355:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602302976 00010000:00010000:3.0:1783951662.808391:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 29 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951662.808684:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:0.0:1783951662.808698:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:2359:x1870608602302976:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951662.808728:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951662.808736:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 29 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.809225:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 29 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.809251:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eecd5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038812 expref: 29 pid: 5793 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.809267:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d452ae300) 00010000:00010000:0.0:1783951662.809274:0:8312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.809283:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.809290:0:8312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951662.809375:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951662.809471:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:2359:x1870608602302976:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 775us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951662.809487:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00010000:00010000:2.0:1783951662.811392:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951662.811604:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951662.812059:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1783951662.812296:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1783951662.812630:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5795:1870608624327424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783951662.813040:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951662.813128:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d45293b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951662.813179:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624327424 00000100:00100000:1.0:1783951662.813188:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624327424 00000100:00100000:1.0:1783951662.813293:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951662.813305:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1870608624327424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783951662.813466:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1870608624327424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 163us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951662.813475:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951662.814022:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5795:1870608624327424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783951662.814735:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1783951662.814934:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5795:1870608624327552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783951662.814995:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951662.815028:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d75628cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951662.815057:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624327552 00000100:00100000:2.0:1783951662.815065:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624327552 00000100:00080000:0.0:1783951662.815143:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951662.815170:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951662.815179:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1870608624327552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783951662.815331:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1870608624327552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (335us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783951662.815338:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783951662.815400:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5795:1870608624327552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783951662.815461:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1783951662.815503:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.815513:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.815522:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.815529:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951662.815534:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.815542:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.815697:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d452ae300) 00010000:00010000:3.0:1783951662.815700:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783951662.815704:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.815709:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecdc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951662.816172:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783951662.816287:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1783951662.816296:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379721485556ns, next at 380721484040ns, rc = 0 00000001:00080000:3.0:1783951662.816303:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1783951662.816383:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d452ae300) 00010000:00010000:3.0:1783951662.816386:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783951662.816399:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eecdaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03883c expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951662.816505:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d518aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:11356:x1870608602302848:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 18029us (18342us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1783951662.816514:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000020:00080000:3.0:1783951662.816519:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783951662.819146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951662.819234:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602303104 00000100:00100000:1.0:1783951662.819241:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602303104 00000100:00100000:1.0:1783951662.819286:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:1.0:1783951662.819297:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:11356:x1870608602303104:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951662.819331:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951662.819356:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecdcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038843 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.819424:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecdcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038843 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.819435:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecdcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038843 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.819459:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951662.819462:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951662.819465:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28600, rc 0) 00000100:00100000:1.0:1783951662.819734:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:11356:x1870608602303104:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 438us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951662.819742:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:0.0:1783951662.823252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951662.823452:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602303360 00000100:00100000:1.0:1783951662.823461:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602303360 00000100:00100000:1.0:1783951662.823744:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:1.0:1783951662.823756:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:11356:x1870608602303360:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951662.824364:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:11356:x1870608602303360:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 608us (1119us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1783951662.824373:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1783951662.978634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951662.978872:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602303616 00000100:00100000:1.0:1783951662.978883:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602303616 00000100:00100000:1.0:1783951662.978964:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 149 00000100:00100000:1.0:1783951662.978974:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:11366:x1870608602303616:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951662.979013:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951662.979035:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecdd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03884a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951662.979163:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783951662.979293:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecdd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03884a expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.979309:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:1.0:1783951662.979312:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951662.979317:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecdd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03884a expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951662.979332:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28000, rc 0) 00000100:00100000:1.0:1783951662.979399:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:11366:x1870608602303616:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 426us (774us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1783951662.979407:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 149 00000100:00100000:2.0:1783951662.985945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951662.986087:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602303744 00000100:00100000:3.0:1783951662.986100:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602303744 00000100:00100000:3.0:1783951662.986159:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 150 00000100:00100000:3.0:1783951662.986170:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:11366:x1870608602303744:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1783951662.986245:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986262:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986273:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986288:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986296:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986303:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986409:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986874:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986894:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951662.986953:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986966:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986973:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986980:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986985:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951662.986989:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.986997:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987007:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951662.987011:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951662.987015:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987021:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eecde0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987043:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987049:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987055:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987060:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951662.987063:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987068:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987075:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf700) 00010000:00010000:3.0:1783951662.987078:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951662.987081:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987087:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecde7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987102:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987108:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987113:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987124:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951662.987128:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987134:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987141:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951662.987144:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951662.987146:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951662.987151:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecdee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951662.987234:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:11366:x1870608602303744:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1064us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951662.987243:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 150 00000100:00100000:0.0:1783951662.992966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951662.993275:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602304000 00000100:00100000:3.0:1783951662.993287:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602304000 00000100:00100000:3.0:1783951662.993347:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:3.0:1783951662.993358:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:11366:x1870608602304000:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951662.994290:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:11366:x1870608602304000:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 929us (1326us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1783951662.994301:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1783951663.043195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951663.043368:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602304256 00000100:00100000:1.0:1783951663.043378:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602304256 00000100:00100000:1.0:1783951663.043453:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 151 00000100:00100000:1.0:1783951663.043464:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:11369:x1870608602304256:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951663.043501:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951663.043524:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecdf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038851 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.043608:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.043651:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.043665:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.043682:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.043689:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.043695:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044143:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044153:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044162:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951663.044173:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783951663.044277:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044286:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044293:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044306:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951663.044311:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044320:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044333:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:1.0:1783951663.044336:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951663.044341:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044348:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecdfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044362:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044368:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044373:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044378:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951663.044381:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044387:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044405:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d71d6d300) 00010000:00010000:1.0:1783951663.044408:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951663.044410:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044416:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eece03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044469:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eecdf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044957:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.044967:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951663.044970:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951663.044972:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28e00, rc 0) 00000100:00100000:1.0:1783951663.045042:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:11369:x1870608602304256:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1580us (1857us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1783951663.045051:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 151 00000100:00100000:2.0:1783951663.049522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951663.050264:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602304384 00000100:00100000:3.0:1783951663.050275:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602304384 00000100:00100000:3.0:1783951663.050461:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:3.0:1783951663.050539:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:11369:x1870608602304384:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1783951663.051746:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.051779:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.051805:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.052062:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.052081:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.052088:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.052094:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951663.052099:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.052117:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.052128:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951663.052131:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951663.052146:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.052154:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951663.052293:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:11369:x1870608602304384:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 1795us (2776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951663.052313:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:0.0:1783951663.058760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951663.058920:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602304640 00000100:00100000:1.0:1783951663.058941:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602304640 00000100:00100000:1.0:1783951663.059006:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:1.0:1783951663.059016:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:11369:x1870608602304640:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951663.059310:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+38:11369:x1870608602304640:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 295us (561us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1783951663.059320:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00010000:00010000:2.0:1783951663.350071:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951663.480245:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624327680:0@lo:400:kworker.0 00000100:00100000:0.0:1783951663.480343:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951663.480419:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624328192:0@lo:400:kworker.0 00000100:00100000:0.0:1783951663.480489:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951663.480701:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624327808:0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.480783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951663.480807:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624328320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.480848:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951663.480875:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951663.480881:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624327936:0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.480904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951663.480946:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624327680 00000100:00100000:1.0:1783951663.480954:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624327680 00000100:00100000:1.0:1783951663.480997:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783951663.481006:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624327680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.481051:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3315:x1870608624327680:12345-0@lo:400:kworker.0 Request processed in 47us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951663.481057:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783951663.481090:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624328320 00000100:00100000:1.0:1783951663.481094:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624328320 00000100:00100000:1.0:1783951663.481118:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783951663.481123:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624328320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.481153:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624328320:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951663.481158:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783951663.481647:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624328320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.482512:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624328192 00000100:00100000:1.0:1783951663.482519:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624328192 00000100:00100000:1.0:1783951663.482619:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624327808 00000100:00100000:1.0:1783951663.482642:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624327808 00000100:00100000:1.0:1783951663.482665:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624327936 00000100:00100000:1.0:1783951663.482712:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624327936 00000100:00100000:1.0:1783951663.482749:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783951663.482758:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624328192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.482967:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624328192:12345-0@lo:400:kworker.0 Request processed in 210us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951663.482975:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783951663.483002:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783951663.483010:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624327808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.483070:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624327808:12345-0@lo:400:kworker.0 Request processed in 61us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951663.483076:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783951663.483171:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624327808:0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.483234:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783951663.483242:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624327936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951663.483294:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624327936:12345-0@lo:400:kworker.0 Request processed in 53us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951663.483301:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783951663.483340:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624327936:0@lo:400:kworker.0 00000100:00080000:2.0:1783951663.485086:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951663.485502:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624328064:0@lo:400:kworker.0 00000100:00100000:3.0:1783951663.485561:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951663.485609:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624328064 00000100:00100000:3.0:1783951663.485615:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624328064 00000100:00100000:3.0:1783951663.485657:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783951663.485666:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624328064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951663.485713:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624328064:12345-0@lo:400:kworker.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951663.485720:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783951663.485761:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624328064:0@lo:400:kworker.0 00000100:00100000:0.0:1783951663.487631:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624328192:0@lo:400:kworker.0 00000100:00100000:0.0:1783951663.487671:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624327680:0@lo:400:kworker.0 00000001:00080000:1.0:1783951663.582726:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1783951663.582747:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1783951663.632984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951663.633093:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602304896 00000100:00100000:2.0:1783951663.633104:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602304896 00000100:00100000:2.0:1783951663.633167:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:2.0:1783951663.633178:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+38:11400:x1870608602304896:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:2.0:1783951663.633218:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951663.633239:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eece1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038858 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.633362:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.633376:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.633389:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951663.633400:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783951663.633535:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eece1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038858 expref: 41 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.633566:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038858 expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.633574:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:2.0:1783951663.633577:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951663.633580:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:2.0:1783951663.633642:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:11400:x1870608602304896:12345-192.168.201.6@tcp:101:cat.0 Request processed in 466us (668us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1783951663.633650:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:2.0:1783951663.640630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951663.640874:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602305024 00000100:00100000:3.0:1783951663.640883:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602305024 00000100:00100000:3.0:1783951663.640965:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1783951663.640976:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:2358:x1870608602305024:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951663.640992:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951663.641017:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038858 expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.641038:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951663.641043:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951663.641104:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:2358:x1870608602305024:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 129us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951663.641129:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1783951663.643270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951663.643405:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602305280 00000100:00100000:1.0:1783951663.643414:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602305280 00000100:00100000:1.0:1783951663.643476:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:1.0:1783951663.643487:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:11400:x1870608602305280:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:1.0:1783951663.643858:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:11400:x1870608602305280:12345-192.168.201.6@tcp:35:cat.0 Request processed in 373us (596us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1783951663.643866:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:1.0:1783951663.750196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951663.750320:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602305536 00000100:00100000:2.0:1783951663.750331:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602305536 00000100:00100000:2.0:1783951663.750412:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 154 00000100:00100000:2.0:1783951663.750422:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:11406:x1870608602305536:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:2.0:1783951663.750458:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951663.750462:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783951663.750489:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecd8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03882e expref: 40 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.750508:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951663.750513:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951663.750528:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eece34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03885f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.750651:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.750665:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 40 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.750674:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.750705:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 40 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.751127:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 40 pid: 5793 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951663.751141:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624328448:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951663.751272:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d517d00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951663.754936:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624328448:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951663.754969:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951663.757761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951663.758333:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602305664 00000100:00100000:0.0:1783951663.758342:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602305664 00010000:00010000:0.0:1783951663.758384:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 41 pid: 5793 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951663.758432:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:0.0:1783951663.758443:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+41:2359:x1870608602305664:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951663.758457:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951663.758465:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 41 pid: 5793 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951663.758479:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 41 pid: 5793 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951663.758519:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eece0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038851 expref: 41 pid: 5793 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951663.758537:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951663.758543:0:8312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951663.758769:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951663.758778:0:8312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951663.758839:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951663.758905:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:2359:x1870608602305664:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 463us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951663.758913:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00010000:00010000:3.0:1783951663.759020:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.759028:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951663.759046:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783951663.759200:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eece34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 41 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.759216:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 40 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951663.759223:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951663.759226:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951663.759228:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:3.0:1783951663.759255:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:11406:x1870608602305536:12345-192.168.201.6@tcp:101:dd.0 Request processed in 8835us (9068us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1783951663.759262:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 154 00000100:00100000:2.0:1783951663.762677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951663.762846:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602305920 00000100:00100000:1.0:1783951663.762856:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602305920 00000100:00100000:1.0:1783951663.762914:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 155 00000100:00100000:1.0:1783951663.763030:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:11406:x1870608602305920:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:1.0:1783951663.763754:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.763773:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951663.763785:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951663.764027:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1783951663.764061:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e6ee4c1 reply state 0000000032b5a0f1 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951663.764071:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951663.764213:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:11406:x1870608602305920:12345-192.168.201.6@tcp:36:dd.0 Request processed in 1286us (1541us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1783951663.764221:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 155 00000020:00080000:1.0:1783951663.764226:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783951663.771775:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.771793:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.771800:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.771806:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951663.771836:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.771844:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.771860:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:2.0:1783951663.771863:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951663.771868:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951663.771874:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eece49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783951663.990263:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380895450255ns, next at 381895447342ns, rc = 0 00000100:00100000:2.0:1783951663.990335:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951663.990359:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c4371c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624328576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951663.990443:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951663.990700:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624328576 00000100:00100000:1.0:1783951663.990721:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624328576 00000100:00100000:1.0:1783951663.990781:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783951663.990803:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624328576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951663.990847:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1783951663.990906:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624328576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951663.990914:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783951663.991042:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1783951663.991048:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1783951663.991075:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c4371c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624328576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951664.119722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.119849:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602306048 00000100:00100000:3.0:1783951664.119859:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602306048 00000100:00100000:3.0:1783951664.119948:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 156 00000100:00100000:3.0:1783951664.119962:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+42:11420:x1870608602306048:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:3.0:1783951664.119985:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951664.120005:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038866 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120074:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120090:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120104:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120118:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120125:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120132:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120237:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120248:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 43 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120276:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120311:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 43 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.120325:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 43 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951664.120339:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624328704:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951664.120444:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4d80 going to sleep for 11 seconds 00000100:00080000:2.0:1783951664.121527:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951664.126511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.126613:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1870608624328704:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951664.126646:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951664.126724:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602306304 00000100:00100000:1.0:1783951664.126732:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602306304 00000100:00100000:1.0:1783951664.126789:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:1.0:1783951664.126800:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+44:5573:x1870608602306304:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783951664.128099:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:5573:x1870608602306304:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 1293us (1591us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1783951664.128111:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:1.0:1783951664.131926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.132051:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602306432 00000100:00100000:3.0:1783951664.132062:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602306432 00010000:00010000:3.0:1783951664.132103:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 45 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951664.132149:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:3.0:1783951664.132159:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:2358:x1870608602306432:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951664.132174:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951664.132182:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 45 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.132216:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 45 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.132238:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eece3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03885f expref: 45 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.132258:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951664.132263:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.132275:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.132282:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.132317:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951664.132377:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+44:2358:x1870608602306432:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 220us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951664.132385:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00010000:00010000:0.0:1783951664.132872:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.132881:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951664.132940:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783951664.132945:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783951664.132971:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.132985:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133003:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133011:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133019:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133025:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951664.133030:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133039:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133050:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:0.0:1783951664.133053:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951664.133057:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133063:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eece57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133075:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133081:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133087:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133098:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951664.133101:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133106:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133115:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf500) 00010000:00010000:0.0:1783951664.133117:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951664.133120:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133127:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eece5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133164:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eece50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038866 expref: 44 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133179:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038866 expref: 43 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.133186:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951664.133188:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951664.133190:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:0.0:1783951664.133231:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:11420:x1870608602306048:12345-192.168.201.6@tcp:101:stat.0 Request processed in 13273us (13530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951664.133238:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 156 00000100:00100000:1.0:1783951664.220142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951664.220255:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602306688 00000100:00100000:2.0:1783951664.220266:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602306688 00000100:00100000:2.0:1783951664.220333:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 157 00000100:00100000:2.0:1783951664.220343:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:11426:x1870608602306688:12345-192.168.201.6@tcp:36:truncate.0 00010000:00010000:2.0:1783951664.220426:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951664.220455:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eece65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038866 expref: 43 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951664.220475:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:2.0:1783951664.220481:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951664.220748:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951664.220763:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951664.220774:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951664.220882:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1783951664.220910:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c05f4902 reply state 0000000024654818 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951664.220931:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951664.221034:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:11426:x1870608602306688:12345-192.168.201.6@tcp:36:truncate.0 Request processed in 691us (903us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1783951664.221042:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 157 00000020:00080000:2.0:1783951664.221047:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783951664.223984:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.224017:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.224026:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.224034:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951664.224039:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.224047:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.224066:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951664.224069:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951664.224074:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.224081:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eece6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.374098:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951664.462347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951664.462457:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602306816 00000100:00100000:0.0:1783951664.462468:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602306816 00000100:00100000:0.0:1783951664.462532:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 158 00000100:00100000:0.0:1783951664.462544:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+44:11440:x1870608602306816:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:0.0:1783951664.462569:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951664.462591:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eece73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03886d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462673:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462703:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462714:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462729:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462735:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462740:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462893:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462902:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462917:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951664.462955:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783951664.462960:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783951664.462980:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.462992:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463015:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463021:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463028:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463034:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951664.463039:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463046:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463060:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:0.0:1783951664.463063:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951664.463068:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463074:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4200/0x443dabd358eece7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463086:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463091:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463096:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463107:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951664.463110:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463116:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463124:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d452aea00) 00010000:00010000:0.0:1783951664.463127:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951664.463130:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463136:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5600/0x443dabd358eece81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463169:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eece73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 46 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463182:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 45 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.463188:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951664.463190:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951664.463193:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4600, rc 0) 00000100:00100000:0.0:1783951664.463268:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:11440:x1870608602306816:12345-192.168.201.6@tcp:101:stat.0 Request processed in 726us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951664.463275:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 158 00000100:00100000:3.0:1783951664.471642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.471686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.471722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.471758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.471791:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602307072 00000100:00100000:3.0:1783951664.471800:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602307072 00000100:00100000:3.0:1783951664.471897:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602307200 00000100:00100000:3.0:1783951664.471927:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602307200 00000100:00100000:3.0:1783951664.471958:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:3.0:1783951664.471967:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602307072:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951664.472040:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602307072:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951664.472049:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:3.0:1783951664.472066:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:3.0:1783951664.472073:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602307200:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951664.472099:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602307200:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951664.472105:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00080000:3.0:1783951664.472127:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951664.472131:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951664.472294:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602306944 00000100:00100000:0.0:1783951664.472304:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602306944 00000100:00100000:0.0:1783951664.472340:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 291 00000100:00100000:0.0:1783951664.472347:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602306944:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951664.472378:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602306944:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 32us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951664.472384:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 291 00000100:00100000:2.0:1783951664.472840:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602307328 00000100:00100000:2.0:1783951664.472845:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602307328 00000100:00100000:2.0:1783951664.472900:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:2.0:1783951664.472917:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602307328:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951664.472955:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602307328:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 48us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951664.472961:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00080000:0.0:1783951664.473064:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951664.692240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951664.692356:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602307584 00000100:00100000:0.0:1783951664.692366:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602307584 00000100:00100000:0.0:1783951664.692436:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 159 00000100:00100000:0.0:1783951664.692446:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+45:11450:x1870608602307584:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951664.692469:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951664.692491:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eece8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038874 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951664.692632:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783951664.692771:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eece8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038874 expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.692785:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:0.0:1783951664.692788:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951664.692794:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eece8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038874 expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.692867:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4000, rc 0) 00000100:00100000:0.0:1783951664.692945:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+46:11450:x1870608602307584:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 500us (714us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1783951664.692967:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 159 00000100:00100000:1.0:1783951664.708020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.708303:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602307840 00000100:00100000:3.0:1783951664.708313:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602307840 00000100:00100000:3.0:1783951664.708370:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:3.0:1783951664.708381:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d518aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+46:11450:x1870608602307840:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951664.708663:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d518aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:11450:x1870608602307840:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 283us (653us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1783951664.708671:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1783951664.815145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951664.815244:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602308096 00000100:00100000:1.0:1783951664.815255:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602308096 00000100:00100000:1.0:1783951664.815319:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 160 00000100:00100000:1.0:1783951664.815329:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:11456:x1870608602308096:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951664.815354:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951664.815375:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eece9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03887b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.815500:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.815535:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 48 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.815545:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.815577:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 48 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.815591:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 48 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951664.815615:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c4371f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624328832:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951664.815784:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d4169a300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951664.824577:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c4371f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624328832:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951664.824622:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951664.825943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.826381:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602308224 00000100:00100000:3.0:1783951664.826390:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602308224 00010000:00010000:3.0:1783951664.826445:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 49 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951664.826573:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:3.0:1783951664.826585:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+49:2359:x1870608602308224:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951664.826609:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951664.826618:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 49 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.826631:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 49 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.826652:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4600/0x443dabd358eece88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03886d expref: 49 pid: 5791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.826670:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951664.826675:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.826685:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.826692:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.826734:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951664.826802:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+48:2359:x1870608602308224:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 219us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951664.826860:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00010000:00010000:1.0:1783951664.826931:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.826939:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951664.826957:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1783951664.827139:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eece9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 49 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.827170:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 48 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.827177:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951664.827180:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951664.827182:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29c00, rc 0) 00000100:00100000:1.0:1783951664.827210:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+48:11456:x1870608602308096:12345-192.168.201.6@tcp:101:bash.0 Request processed in 11884us (12086us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1783951664.827218:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 160 00000100:00100000:2.0:1783951664.835221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951664.835286:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602308480 00000100:00100000:0.0:1783951664.835296:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602308480 00000100:00100000:0.0:1783951664.835364:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:0.0:1783951664.835373:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+48:11456:x1870608602308480:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:0.0:1783951664.835684:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.835700:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.836061:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951664.836133:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1783951664.836161:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9ea4b91 reply state 000000007a6a1baf transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951664.836171:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951664.836267:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+51:11456:x1870608602308480:12345-192.168.201.6@tcp:36:bash.0 Request processed in 892us (1053us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783951664.836275:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 161 00000020:00080000:0.0:1783951664.836280:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783951664.842696:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.842714:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.842722:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.842743:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951664.842748:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.842756:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.842772:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951664.842776:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951664.842780:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951664.842787:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eeceb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951664.845173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951664.845323:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602308608 00000100:00100000:1.0:1783951664.845334:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602308608 00000100:00100000:1.0:1783951664.845396:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:1.0:1783951664.845411:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:11456:x1870608602308608:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951664.845437:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951664.845469:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eeceb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038882 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.845564:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.845580:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 51 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.845590:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.845637:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 51 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.845664:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 51 pid: 5793 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951664.845677:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c4371f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624328960:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951664.845759:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d4169aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951664.853699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.853836:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602308736 00000100:00100000:3.0:1783951664.853856:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602308736 00010000:00010000:3.0:1783951664.853898:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 52 pid: 5793 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951664.853950:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:3.0:1783951664.853961:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:2358:x1870608602308736:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951664.853978:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951664.853984:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 52 pid: 5793 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.853997:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 52 pid: 5793 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.854019:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951664.854024:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.854032:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.854039:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951664.854058:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951664.854124:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:2358:x1870608602308736:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 164us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951664.854131:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00010000:00010000:1.0:1783951664.854656:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecea4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03887b expref: 51 pid: 5793 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951664.854673:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c4371f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624328960:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951664.854694:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.854703:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.854721:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951664.854771:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783951664.854776:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951664.854797:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.854873:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eeceb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038882 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.854888:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038882 expref: 50 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951664.854915:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951664.854918:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951664.854921:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29200, rc 0) 00000100:00100000:1.0:1783951664.854959:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:11456:x1870608602308608:12345-192.168.201.6@tcp:101:bash.0 Request processed in 9555us (9795us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951664.854965:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:2.0:1783951664.868542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951664.868639:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602308992 00000100:00100000:3.0:1783951664.868649:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602308992 00000100:00100000:3.0:1783951664.868724:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1783951664.868734:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:11456:x1870608602308992:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:3.0:1783951664.869033:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+51:11456:x1870608602308992:12345-192.168.201.6@tcp:35:bash.0 Request processed in 300us (500us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1783951664.869041:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:0.0:1783951665.060446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.061320:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602309248 00000100:00100000:1.0:1783951665.061332:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602309248 00000100:00100000:1.0:1783951665.061681:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:1.0:1783951665.061693:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+51:11466:x1870608602309248:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951665.061730:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951665.061755:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038889 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951665.061895:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783951665.062049:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecec7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038889 expref: 53 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.062065:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:1.0:1783951665.062069:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951665.062074:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038889 expref: 53 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.062089:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29800, rc 0) 00000100:00100000:1.0:1783951665.062168:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:11466:x1870608602309248:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 477us (1734us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1783951665.062190:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:3.0:1783951665.068064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951665.068215:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602309376 00000100:00100000:2.0:1783951665.068225:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602309376 00000100:00100000:2.0:1783951665.068316:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:2.0:1783951665.068328:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:11466:x1870608602309376:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:2.0:1783951665.068418:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.068435:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.068456:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.068471:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.068477:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.068499:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.068962:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.068972:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.068979:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951665.069028:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069041:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069047:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069053:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069059:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951665.069064:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069071:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069083:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951665.069093:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951665.069099:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069105:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eeced5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069189:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069198:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069204:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069209:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951665.069212:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069218:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069227:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d44e70c00) 00010000:00010000:2.0:1783951665.069229:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951665.069232:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069238:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecedc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069252:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069264:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069271:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069277:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951665.069280:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069287:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069294:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:2.0:1783951665.069297:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951665.069300:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.069306:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecee3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951665.069383:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:11466:x1870608602309376:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1056us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951665.069392:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:2.0:1783951665.073491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.073628:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602309632 00000100:00100000:3.0:1783951665.073638:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602309632 00000100:00100000:3.0:1783951665.073701:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1783951665.073721:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:11466:x1870608602309632:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951665.074036:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+53:11466:x1870608602309632:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 325us (555us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783951665.074044:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1783951665.154047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.154188:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602309888 00000100:00100000:3.0:1783951665.154199:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602309888 00000100:00100000:3.0:1783951665.154263:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:3.0:1783951665.154275:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+53:11469:x1870608602309888:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951665.154301:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951665.154323:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eeceea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038890 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154411:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154426:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154465:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154481:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154490:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154497:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154943:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eeceff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154953:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eeceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.154961:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eeceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951665.154972:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783951665.155066:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155073:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155091:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155097:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951665.155107:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155115:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155126:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951665.155129:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951665.155133:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155139:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecef1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155152:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155157:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155162:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155168:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951665.155170:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155175:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155181:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf000) 00010000:00010000:3.0:1783951665.155183:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951665.155192:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155198:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155240:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eeceea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038890 expref: 56 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155253:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eeceff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038890 expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.155259:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951665.155261:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951665.155263:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8600, rc 0) 00000100:00100000:3.0:1783951665.155327:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:11469:x1870608602309888:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1055us (1289us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1783951665.155334:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:2.0:1783951665.162113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951665.162166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951665.162259:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602310016 00000100:00100000:0.0:1783951665.162269:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602310016 00000100:00100000:0.0:1783951665.162337:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1783951665.162347:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:2359:x1870608602310016:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951665.162363:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951665.162388:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eeceff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038890 expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.162416:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951665.162422:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951665.162489:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:2359:x1870608602310016:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 143us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951665.162667:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1783951665.163110:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602310144 00000100:00100000:1.0:1783951665.163116:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602310144 00000100:00100000:1.0:1783951665.163157:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:1.0:1783951665.163164:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:11469:x1870608602310144:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1783951665.163218:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163232:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163243:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163272:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163279:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163286:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163292:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951665.163297:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163305:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163314:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951665.163324:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951665.163329:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.163335:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951665.163383:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:11469:x1870608602310144:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 219us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951665.163390:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:2.0:1783951665.168227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.168312:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602310400 00000100:00100000:3.0:1783951665.168322:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602310400 00000100:00100000:3.0:1783951665.168379:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:3.0:1783951665.168388:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:11469:x1870608602310400:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951665.168962:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:11469:x1870608602310400:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 573us (742us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1783951665.168970:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:0.0:1783951665.379028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.379193:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602310656 00000100:00100000:3.0:1783951665.379203:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602310656 00000100:00100000:3.0:1783951665.379263:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:3.0:1783951665.379274:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:11487:x1870608602310656:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:3.0:1783951665.379310:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951665.379333:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecf14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038897 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.379454:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecf1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.379469:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecf1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.379479:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecf1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951665.379490:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783951665.379978:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecf14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038897 expref: 58 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.379999:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecf1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038897 expref: 57 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.380008:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951665.380012:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783951665.380016:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9800, rc 0) 00000100:00100000:3.0:1783951665.380088:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:11487:x1870608602310656:12345-192.168.201.6@tcp:101:cat.0 Request processed in 815us (1069us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1783951665.380095:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 167 00010000:00010000:2.0:1783951665.399127:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951665.415181:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.415287:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602310784 00000100:00100000:1.0:1783951665.415296:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602310784 00000100:00100000:1.0:1783951665.415350:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:1.0:1783951665.415360:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:11488:x1870608602310784:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951665.415381:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951665.415486:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03889e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.415557:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecf30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.415570:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecf30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.415581:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecf30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951665.415655:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783951665.415659:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951665.415677:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecf30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.415712:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03889e expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.415729:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecf30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03889e expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.415737:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:1.0:1783951665.415740:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951665.415744:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29c00, rc 0) 00000100:00100000:1.0:1783951665.415800:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+58:11488:x1870608602310784:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 441us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951665.415806:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:2.0:1783951665.423023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.423118:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602311168 00000100:00100000:1.0:1783951665.423128:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602311168 00000100:00100000:1.0:1783951665.423185:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:1.0:1783951665.423196:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+58:11488:x1870608602311168:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951665.423568:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:11488:x1870608602311168:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 373us (554us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1783951665.423577:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:0.0:1783951665.426610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.426797:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602311296 00000100:00100000:3.0:1783951665.426807:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602311296 00000100:00100000:3.0:1783951665.426941:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1783951665.426968:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:11488:x1870608602311296:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:3.0:1783951665.426988:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783951665.427016:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29200/0x443dabd358eecec0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038882 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.427039:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecf1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038897 expref: 58 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.427051:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eecdcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038843 expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.427061:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951665.427072:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951665.427128:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:11488:x1870608602311296:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 163us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951665.427136:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1783951665.430562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.430662:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602311424 00000100:00100000:1.0:1783951665.430671:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602311424 00000100:00100000:1.0:1783951665.430739:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:1.0:1783951665.430749:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:11488:x1870608602311424:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:1.0:1783951665.430903:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.430937:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.430949:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951665.431146:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1783951665.431233:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:11488:x1870608602311424:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 485us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951665.431240:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:0.0:1783951665.458160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951665.458262:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602311552 00000100:00100000:2.0:1783951665.458272:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602311552 00000100:00100000:2.0:1783951665.458334:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 170 00000100:00100000:2.0:1783951665.458347:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:11490:x1870608602311552:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951665.458367:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951665.458387:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecf3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458453:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458467:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458478:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458493:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458511:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458519:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458642:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458651:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458674:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951665.458724:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783951665.458729:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951665.458748:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458760:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458768:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458775:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458782:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458787:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951665.458791:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458797:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458844:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951665.458848:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951665.458852:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458869:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecf45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458883:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458889:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458906:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458911:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951665.458914:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458919:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458927:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d44e70c00) 00010000:00010000:2.0:1783951665.458930:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951665.458932:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458937:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecf4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458968:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eecf3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458981:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.458995:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:2.0:1783951665.458997:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951665.458999:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:2.0:1783951665.459070:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:11490:x1870608602311552:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 725us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951665.459077:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 170 00000001:00080000:0.0:1783951665.617104:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000001:00080000:0.0:1783951665.617141:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:0.0:1783951665.617151:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1783951665.617228:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783951665.617240:0:5813:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8d75628840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1783951665.617246:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d44b72000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d75628000 00000020:00080000:0.0:1783951665.617249:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d44b72d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d60b09c00 00000020:00080000:0.0:1783951665.617271:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1783951665.617923:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1783951665.618979:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624329088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783951665.619046:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951665.619135:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624329088 00000100:00100000:0.0:1783951665.619142:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624329088 00000100:00100000:0.0:1783951665.619193:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783951665.619202:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624329088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783951665.619228:0:8067:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1783951665.619265:0:8067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a54f12e, atime: 0x6a54f12f, ctime: 0x6a54f12e, blocks: 0xb 00010000:00010000:0.0:1783951665.619273:0:8067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.619291:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1783951665.619296:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951665.619313:0:8067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.619344:0:8067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.619356:0:8067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.619365:0:8067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.619384:0:8067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1783951665.625111:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783951665.628169:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951665.628181:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.628196:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951665.628201:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.628214:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.628237:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.628264:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eecf5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.628289:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951665.628291:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951665.628293:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951665.629193:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624329088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9986us (10140us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783951665.629206:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1783951665.632106:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d79bdfb80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1783951665.632130:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624329088:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1783951665.654059:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951665.654069:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951665.654142:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783951665.654150:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951665.654273:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811d1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624329216:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951665.654371:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d517d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951665.658338:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811d1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624329216:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951665.659560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.659693:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602311680 00000100:00100000:1.0:1783951665.659701:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602311680 00000100:00100000:1.0:1783951665.659758:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:1.0:1783951665.659768:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:11501:x1870608602311680:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783951665.659798:0:5791:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783951665.659940:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:11501:x1870608602311680:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 173us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951665.659948:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:0.0:1783951665.669840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.671960:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602311808 00000100:00100000:1.0:1783951665.671973:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602311808 00000100:00100000:1.0:1783951665.672035:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:1.0:1783951665.672045:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:11501:x1870608602311808:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783951665.672117:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672147:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672158:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672175:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672181:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672188:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672216:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672225:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672233:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951665.672277:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783951665.672281:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951665.672293:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672304:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672507:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672516:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672522:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951665.672527:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672535:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672548:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:1.0:1783951665.672551:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951665.672555:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672561:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672572:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672578:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672650:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672657:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951665.672667:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672674:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672683:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e8d71d6df00) 00010000:00010000:1.0:1783951665.672686:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951665.672689:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672696:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf68 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672712:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672718:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672724:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672729:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951665.672732:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672737:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672744:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:1.0:1783951665.672747:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951665.672756:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.672762:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eecf6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951665.673570:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:11501:x1870608602311808:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 1520us (3760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951665.673591:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:3.0:1783951665.690473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.691429:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602312064 00000100:00100000:1.0:1783951665.691439:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602312064 00000100:00100000:1.0:1783951665.691490:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:1.0:1783951665.691500:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+16:11501:x1870608602312064:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951665.691523:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951665.691543:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388ac expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.691658:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.691673:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.691684:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951665.691695:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783951665.692136:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692145:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692160:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692166:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28e00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951665.692171:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692180:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692191:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:1.0:1783951665.692194:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951665.692199:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692204:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecf7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692242:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf76 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ac expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692251:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:1.0:1783951665.692253:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951665.692256:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eecf76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ac expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.692265:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28800, rc 0) 00000100:00100000:1.0:1783951665.692449:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11501:x1870608602312064:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 948us (1982us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1783951665.692478:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:1.0:1783951665.700231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951665.700536:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602312192 00000100:00100000:2.0:1783951665.700546:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602312192 00000100:00100000:2.0:1783951665.700957:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:2.0:1783951665.700968:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11501:x1870608602312192:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951665.701019:0:5792:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951665.701282:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11501:x1870608602312192:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 315us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951665.701291:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:1.0:1783951665.706219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951665.706855:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602312448 00000100:00100000:0.0:1783951665.706864:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602312448 00000100:00100000:0.0:1783951665.707033:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 175 00000100:00100000:0.0:1783951665.707044:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11501:x1870608602312448:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951665.707068:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951665.707071:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783951665.707099:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eecf30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03889e expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.707120:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:0.0:1783951665.707126:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951665.707141:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eecf8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388b3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951665.709246:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1783951665.710296:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecf92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.711307:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecf92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.711332:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecf92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.715626:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eecf8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388b3 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.715654:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecf92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388b3 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951665.715664:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d452aee00) 00010000:00010000:0.0:1783951665.715667:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951665.715670:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5800, rc 0) 00000100:00100000:0.0:1783951665.715750:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11501:x1870608602312448:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 8706us (9539us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1783951665.715759:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 175 00000100:00100000:0.0:1783951665.726046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951665.734532:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602312704 00000100:00100000:2.0:1783951665.734547:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602312704 00000100:00100000:2.0:1783951665.734653:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:2.0:1783951665.734671:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11501:x1870608602312704:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783951665.734749:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951665.734776:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eecf92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388b3 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.734794:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d452aee00) 00010000:00010000:2.0:1783951665.734805:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951665.734845:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.734859:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.734868:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.734902:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.734910:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.734918:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735211:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735219:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735237:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735244:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951665.735248:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735257:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735266:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951665.735269:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951665.735272:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735277:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eecfa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735286:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735292:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735297:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735302:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951665.735305:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735319:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735328:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xcb8d684 (ffff8e8d44e70c00) 00010000:00010000:2.0:1783951665.735330:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951665.735332:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.735337:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eecfa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcb8d684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951665.735445:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11501:x1870608602312704:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 775us (9407us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951665.735454:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:2.0:1783951665.740365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.740484:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602312832 00000100:00100000:3.0:1783951665.740494:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602312832 00000100:00100000:3.0:1783951665.740548:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00100000:3.0:1783951665.740558:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11501:x1870608602312832:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951665.740579:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951665.740694:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecfae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388ba expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.740756:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.740770:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.740781:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.741171:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eecfae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 19 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.741189:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951665.741197:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:2.0:1783951665.741200:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783951665.741204:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8800, rc 0) 00000100:00100000:2.0:1783951665.741270:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11501:x1870608602312832:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 713us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951665.741278:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00100000:0.0:1783951665.744151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.744247:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602313088 00000100:00100000:3.0:1783951665.744256:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602313088 00000100:00100000:3.0:1783951665.744308:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 178 00000100:00100000:3.0:1783951665.744317:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11501:x1870608602313088:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951665.744400:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.744417:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.744429:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951665.744756:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1783951665.744766:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382649955428ns, next at 383649952610ns, rc = 0 00000004:00010000:3.0:1783951665.745125:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f049af03 reply state 000000000cf7f0e9 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951665.745135:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951665.745258:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11501:x1870608602313088:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 940us (1113us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1783951665.745278:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 178 00010000:00010000:1.0:1783951665.752659:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.752678:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.752685:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.752692:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951665.752697:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.752704:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.752720:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:1.0:1783951665.752723:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783951665.752727:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.752733:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eecfbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951665.753294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.753359:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602313216 00000100:00100000:1.0:1783951665.753369:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602313216 00000100:00100000:1.0:1783951665.753430:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 179 00000100:00100000:1.0:1783951665.753440:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:11501:x1870608602313216:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951665.753477:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951665.753494:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.753567:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.753580:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.753699:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:1.0:1783951665.753702:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951665.753705:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28e00, rc 0) 00000100:00100000:1.0:1783951665.753761:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11501:x1870608602313216:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 322us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951665.753769:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 179 00000100:00100000:2.0:1783951665.757194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.757265:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602313344 00000100:00100000:3.0:1783951665.757273:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602313344 00000100:00100000:3.0:1783951665.757328:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:3.0:1783951665.757338:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602313344:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783951665.758040:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602313344:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 701us (852us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783951665.758049:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:1.0:1783951665.763388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.763476:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602313600 00000100:00100000:3.0:1783951665.763486:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602313600 00000100:00100000:3.0:1783951665.763548:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:3.0:1783951665.763559:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11501:x1870608602313600:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783951665.763861:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:11501:x1870608602313600:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 303us (483us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1783951665.763870:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:0.0:1783951665.766690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951665.766777:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602313856 00000100:00100000:2.0:1783951665.766785:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602313856 00000100:00100000:2.0:1783951665.766857:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 180 00000100:00100000:2.0:1783951665.766868:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:11501:x1870608602313856:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783951665.766981:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:11501:x1870608602313856:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 114us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951665.766990:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 180 00000100:00100000:3.0:1783951665.769569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951665.769665:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602313984 00000100:00100000:0.0:1783951665.769675:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602313984 00000100:00100000:0.0:1783951665.769740:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 181 00000100:00100000:0.0:1783951665.769750:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:11501:x1870608602313984:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951665.769769:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951665.769802:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecfca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388c8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.773010:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecfd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.773033:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.773047:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951665.773093:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951665.773113:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.773163:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eecfca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c8 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.773183:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c8 expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.773193:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:3.0:1783951665.773196:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783951665.773200:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8200, rc 0) 00000100:00100000:3.0:1783951665.774315:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:11501:x1870608602313984:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 4560us (4750us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951665.774324:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 181 00000100:00100000:0.0:1783951665.782057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.786259:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602314112 00000100:00100000:1.0:1783951665.786274:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602314112 00000100:00100000:1.0:1783951665.786341:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:1.0:1783951665.786352:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602314112:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951665.786373:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951665.786486:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388cf expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951665.786516:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54f132, blocks: 0x1 00010000:00010000:1.0:1783951665.786536:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1783951665.786556:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951665.786568:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 8 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.786646:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 8 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.786661:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29600, rc 0) 00000100:00100000:1.0:1783951665.786758:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602314112:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 407us (4709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951665.786766:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:1.0:1783951665.790187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951665.790374:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602314368 00000100:00100000:2.0:1783951665.790383:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602314368 00000100:00100000:2.0:1783951665.790451:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 182 00000100:00100000:2.0:1783951665.790462:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:11501:x1870608602314368:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783951665.790578:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:11501:x1870608602314368:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 117us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951665.790595:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 182 00000100:00100000:2.0:1783951665.793278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951665.793365:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602314496 00000100:00100000:1.0:1783951665.793374:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602314496 00000100:00100000:1.0:1783951665.793439:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1783951665.793449:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:11501:x1870608602314496:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951665.793468:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951665.793486:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388d6 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.793523:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 9 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.793532:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951665.793536:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951665.793541:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.793608:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 9 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951665.793623:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 9 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951665.793638:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c4371e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624329344:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951665.793729:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951665.796715:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c4371e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624329344:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951665.796749:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.796771:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28400, rc 0) 00000100:00100000:3.0:1783951665.796847:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:11501:x1870608602314496:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 3398us (3576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951665.796856:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1783951665.805337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.805473:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602314624 00000100:00100000:3.0:1783951665.805483:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602314624 00010000:00010000:3.0:1783951665.805525:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 9 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951665.805570:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:3.0:1783951665.805604:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2358:x1870608602314624:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951665.805620:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951665.805644:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 9 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.805658:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 9 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.805684:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dbca665/0x443dabd358eecfd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388cf expref: 9 pid: 6591 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.805701:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951665.805706:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951665.805714:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.805725:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.805764:0:8312:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951665.805778:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8312:1870608624329472:192.168.201.6@tcp:105: 00000100:00100000:3.0:1783951665.805873:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d604e7900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951665.810605:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8312:1870608624329472:192.168.201.6@tcp:105: 00010000:00010000:3.0:1783951665.810655:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951665.810726:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602314624:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 5123us (5395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951665.810737:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:1.0:1783951665.815168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.815276:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602314752 00000100:00100000:3.0:1783951665.815286:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602314752 00002000:00100000:3.0:1783951665.815336:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e8c4371e300 x1870608602314752/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:681/0 lens 504/0 e 0 to 0 dl 1783951676 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951665.815347:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8c4371e300 with x1870608602314752 ext(0->8) 00002000:00010000:3.0:1783951665.815352:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8c4371e300 00000100:00100000:3.0:1783951665.815378:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:3.0:1783951665.815399:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602314752:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783951665.815899:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:2359:x1870608602314752:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 511us (739us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1783951665.815908:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00002000:00100000:3.0:1783951665.815915:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e8c4371e300 x1870608602314752/t4294967315(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:681/0 lens 504/448 e 0 to 0 dl 1783951676 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951665.815923:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8c4371e300 with x1870608602314752 ext(0->8) 00002000:00010000:3.0:1783951665.815926:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8c4371e300 00000100:00100000:1.0:1783951665.819910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951665.819993:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602314880 00000100:00100000:0.0:1783951665.820001:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602314880 00000100:00100000:0.0:1783951665.820051:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 183 00000100:00100000:0.0:1783951665.820061:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:11501:x1870608602314880:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783951665.868040:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:0.0:1783951665.868055:0:5813:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1783951665.868068:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1783951665.868073:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1783951665.868085:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1783951665.868095:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783951665.868848:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951665.868874:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d759a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624329600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783951665.868991:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951665.869069:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624329600 00000100:00100000:1.0:1783951665.869079:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624329600 00000100:00100000:1.0:1783951665.869157:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783951665.869166:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624329600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783951665.869329:0:8067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783951665.869332:0:8067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783951666 00002000:00010000:1.0:1783951665.869335:0:8067:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783951665.869337:0:8067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783951666 -> 1783951666 00002000:00010000:1.0:1783951665.869339:0:8067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783951665.869380:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624329600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (389us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1783951665.869401:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1783951665.869423:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783951665.869471:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d759a3480/2, rc 0, transno 4294967316 00000100:00100000:1.0:1783951665.869477:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d759a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624329600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783951665.888040:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11501:x1870608602314880:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 67967us (68126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951665.888054:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 183 00000100:00100000:3.0:1783951665.891129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951665.891237:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602315008 00000100:00100000:0.0:1783951665.891246:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602315008 00000100:00100000:0.0:1783951665.891305:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:0.0:1783951665.891316:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:2359:x1870608602315008:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783951665.980075:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:2359:x1870608602315008:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 88753us (88946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951665.980091:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000001:00080000:2.0:1783951665.991092:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1783951665.991125:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1783951665.994340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951665.994688:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602315264 00000100:00100000:3.0:1783951665.994699:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602315264 00000100:00100000:3.0:1783951665.994773:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 184 00000100:00100000:3.0:1783951665.994785:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11501:x1870608602315264:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951665.994941:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951665.994971:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eecfd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c8 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.994988:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:3.0:1783951665.994994:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951665.995027:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.995042:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951665.995053:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951665.995332:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e461198 reply state 00000000e74bceaf transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951665.995356:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951665.995448:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:11501:x1870608602315264:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 665us (1118us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1783951665.995455:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 184 00000100:00100000:2.0:1783951666.008605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951666.008650:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602315392 00000100:00100000:2.0:1783951666.008661:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602315392 00000100:00100000:2.0:1783951666.008722:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:2.0:1783951666.008733:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2361:x1870608602315392:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1783951666.008937:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.008949:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.008956:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.008969:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.008974:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.008983:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.008999:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:3.0:1783951666.009001:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951666.009005:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.009010:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecfe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951666.009022:0:8067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783951666.009026:0:8067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783951666 -> 1783951665 00002000:00010000:2.0:1783951666.009028:0:8067:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783951663 00002000:00010000:2.0:1783951666.009036:0:8067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783951666 -> 1783951665 00002000:00010000:2.0:1783951666.009038:0:8067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783951666.009112:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2361:x1870608602315392:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 381us (517us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783951666.009120:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00080000:2.0:1783951666.009142:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951666.012864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951666.013198:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602315648 00000100:00100000:2.0:1783951666.013207:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602315648 00000100:00100000:2.0:1783951666.013271:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 185 00000100:00100000:2.0:1783951666.013281:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11501:x1870608602315648:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783951666.013345:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.013362:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.013372:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.013406:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.013420:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 18 pid: 8068 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783951666.013423:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951666.013446:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624329728:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951666.013680:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d517d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951666.017220:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624329728:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951666.017260:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.022744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951666.023314:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602315776 00000100:00100000:1.0:1783951666.023324:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602315776 00010000:00010000:1.0:1783951666.023364:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 19 pid: 8068 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951666.023511:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:1.0:1783951666.023522:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:2359:x1870608602315776:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951666.023537:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951666.023545:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 19 pid: 8068 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.023558:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 19 pid: 8068 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.023589:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eecfb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388ba expref: 19 pid: 8068 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.023602:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:1.0:1783951666.023607:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.023617:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.023633:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.023664:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951666.023712:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:2359:x1870608602315776:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 192us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951666.023720:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00010000:00010000:3.0:1783951666.026717:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.026734:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.026772:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.026779:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.026785:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.026803:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.026807:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.026832:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.026847:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:3.0:1783951666.026850:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783951666.026854:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.026860:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eecfed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.026959:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11501:x1870608602315648:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 13674us (14099us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783951666.026971:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 185 00000100:00100000:3.0:1783951666.035218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951666.035300:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602315904 00000100:00100000:1.0:1783951666.035310:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602315904 00000100:00100000:1.0:1783951666.035372:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:1.0:1783951666.035382:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2361:x1870608602315904:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783951666.035427:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.035449:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.035457:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951666.035462:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951666.035466:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.035518:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.035532:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 8 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951666.035565:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c420cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624329856:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951666.035656:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d4000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951666.038356:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c420cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1870608624329856:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951666.038385:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.039726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951666.039905:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602316032 00000100:00100000:1.0:1783951666.039913:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602316032 00010000:00010000:1.0:1783951666.039964:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 9 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951666.040002:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:1.0:1783951666.040013:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2358:x1870608602316032:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951666.040027:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951666.040060:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 9 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.040080:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 9 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.040129:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eecfdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388d6 expref: 9 pid: 6590 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.040147:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951666.040158:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951666.040165:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.040176:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.040230:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951666.040280:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602316032:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 268us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951666.040288:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00010000:00010000:2.0:1783951666.040913:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.040926:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.040956:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.040965:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.040973:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.040980:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29a00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951666.040985:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.040993:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.041007:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.041026:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007466eb75/0x443dabd358eecff4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951666.041102:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2361:x1870608602315904:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 5713us (5886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951666.041112:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:0.0:1783951666.046032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.049273:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602316288 00000100:00100000:3.0:1783951666.049287:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602316288 00000100:00100000:3.0:1783951666.049752:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 186 00000100:00100000:3.0:1783951666.049764:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+17:11501:x1870608602316288:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783951666.049870:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.049900:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.049912:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.050622:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.050638:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.050646:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.050681:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.050695:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 18 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.050708:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624329984:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951666.050895:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951666.058079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951666.058419:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602316416 00000100:00100000:2.0:1783951666.058428:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602316416 00010000:00010000:2.0:1783951666.058469:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 19 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951666.058642:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:2.0:1783951666.058654:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:2358:x1870608602316416:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951666.058671:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951666.058679:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 19 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.058692:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 19 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.058716:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:2.0:1783951666.058721:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.058732:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.058751:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.058775:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951666.058870:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:2358:x1870608602316416:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 218us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951666.058878:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00010000:00010000:1.0:1783951666.059263:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28e00/0x443dabd358eecfc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388c1 expref: 18 pid: 5791 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951666.059280:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624329984:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951666.059303:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.059313:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.059320:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951666.059960:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1783951666.060119:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1783951666.060167:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1783951666.060246:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c420c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5792:1870608624330112:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783951666.060299:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951666.060372:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d65c48780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951666.061564:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624330112 00000100:00100000:0.0:1783951666.061574:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624330112 00000100:00100000:1.0:1783951666.061873:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951666.061892:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1870608624330112:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783951666.061987:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1870608624330112:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951666.062007:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951666.062094:0:5792:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1783951666.062101:0:5792:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d759a3480, transno 4294967316 00000100:00100000:1.0:1783951666.062148:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c420c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5792:1870608624330112:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1783951666.062942:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1783951666.063008:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c420c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5792:1870608624330240:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783951666.063060:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951666.063085:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d65c48900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951666.063561:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624330240 00000100:00100000:0.0:1783951666.063568:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624330240 00000100:00100000:0.0:1783951666.063727:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951666.063737:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1870608624330240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783951666.063938:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5792:x1870608624330240:12345-0@lo:1000:mdt00_001.0 Request processed in 203us (878us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783951666.063947:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951666.064120:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c420c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5792:1870608624330240:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783951666.064156:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064167:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064175:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064181:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951666.064185:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064193:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064208:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d821cf000) 00010000:00010000:1.0:1783951666.064211:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951666.064216:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064229:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed002 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064258:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064264:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064270:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064275:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951666.064278:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064284:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064292:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:1.0:1783951666.064294:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951666.064296:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064301:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29800/0x443dabd358eecf37 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064321:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064335:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064350:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064379:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.064659:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 21 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951666.064673:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c420cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624330368:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951666.066026:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951666.072683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951666.072852:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602316544 00000100:00100000:0.0:1783951666.072861:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602316544 00010000:00010000:0.0:1783951666.072910:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 22 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951666.072944:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:0.0:1783951666.072954:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:2358:x1870608602316544:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951666.072971:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951666.072978:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 22 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.072991:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 22 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.073016:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:0.0:1783951666.073021:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.073033:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.073042:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.073061:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951666.073119:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:2358:x1870608602316544:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 166us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951666.073127:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00010000:00010000:3.0:1783951666.073423:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eecf53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388a5 expref: 21 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.073462:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c420cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624330368:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951666.073485:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.075340:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.075347:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.075359:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.075365:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.075372:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.075378:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.075382:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076258:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076276:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:3.0:1783951666.076279:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951666.076284:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076301:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed009 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076316:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076321:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076326:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076330:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.076333:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076340:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076347:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d71d6db00) 00010000:00010000:3.0:1783951666.076350:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783951666.076353:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.076357:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eecffb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.077275:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11501:x1870608602316288:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 27508us (31248us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1783951666.077287:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 186 00000020:00080000:3.0:1783951666.077301:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783951666.077673:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951666.077678:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951666.078455:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1783951666.078466:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783951666.085278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951666.085371:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602316800 00000100:00100000:0.0:1783951666.085389:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602316800 00000100:00100000:0.0:1783951666.085448:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1783951666.085458:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d601d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11501:x1870608602316800:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783951666.086174:0:5794:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783951666.086285:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1783951666.086330:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.086348:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.086361:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.086371:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.086378:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.086385:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951666.086403:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783951666.086495:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d601d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:11501:x1870608602316800:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1037us (1225us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1783951666.086504:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000020:00080000:0.0:1783951666.086516:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783951666.086736:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951666.086744:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.086752:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951666.086756:0:8311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.086763:0:8311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.086775:0:8311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8d452ae300) 00010000:00010000:2.0:1783951666.086778:0:8311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783951666.086792:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.086798:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4000/0x443dabd358eed010 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.086843:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951666.086845:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951666.086846:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951666.386607:0:12381:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951666.386617:0:12381:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951666.386659:0:12381:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783951666.386665:0:12381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783951666.422003:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951666.651661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.651700:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602317056 00000100:00100000:3.0:1783951666.651723:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602317056 00000100:00100000:3.0:1783951666.651777:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 187 00000100:00100000:3.0:1783951666.651786:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:11511:x1870608602317056:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951666.651834:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951666.651860:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388dd expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.654297:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eed01e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.654322:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eed01e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.654335:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eed01e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951666.654353:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783951666.654962:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388dd expref: 25 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.654984:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eed01e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388dd expref: 24 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.654994:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951666.654998:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951666.655000:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8800, rc 0) 00000100:00100000:3.0:1783951666.655158:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:11511:x1870608602317056:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 3305us (3441us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1783951666.655167:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 187 00000100:00100000:0.0:1783951666.661238:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.661567:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602317184 00000100:00100000:3.0:1783951666.661577:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602317184 00000100:00100000:3.0:1783951666.662591:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 188 00000100:00100000:3.0:1783951666.662604:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:11511:x1870608602317184:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1783951666.662685:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.662703:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.662715:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.662731:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.662737:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.662742:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663053:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663062:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663069:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951666.663126:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663139:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663145:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663152:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663159:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.663162:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663170:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663181:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951666.663184:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951666.663189:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663196:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed02c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663206:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663213:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663224:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663230:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.663233:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663238:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663246:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951666.663248:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951666.663251:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663258:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663272:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663278:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663284:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663289:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.663292:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663307:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663316:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf700) 00010000:00010000:3.0:1783951666.663318:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951666.663320:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.663325:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed03a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.663404:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:11511:x1870608602317184:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 801us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951666.663413:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 188 00000100:00100000:0.0:1783951666.740105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.740223:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602317440 00000100:00100000:3.0:1783951666.740234:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602317440 00000100:00100000:3.0:1783951666.740327:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 189 00000100:00100000:3.0:1783951666.740338:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:11514:x1870608602317440:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951666.740362:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951666.740382:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388e4 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740451:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740466:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740476:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740513:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740520:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740527:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740911:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740920:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.740927:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951666.740937:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783951666.741023:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.741031:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.741038:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.741044:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.741048:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.741066:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.741078:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951666.741081:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951666.741085:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.742579:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.742598:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.742604:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.742610:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.742615:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.742618:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.742625:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.742638:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf700) 00010000:00010000:3.0:1783951666.742641:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951666.742644:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.742660:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed04f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.743173:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 27 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.743192:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 26 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.743200:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951666.743203:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951666.743206:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:3.0:1783951666.743277:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:11514:x1870608602317440:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 2940us (3194us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1783951666.743286:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 189 00000100:00100000:2.0:1783951666.752182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.752319:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602317568 00000100:00100000:3.0:1783951666.752329:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602317568 00000100:00100000:3.0:1783951666.752384:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:3.0:1783951666.752394:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:11514:x1870608602317568:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1783951666.752462:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752489:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752504:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752551:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752559:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752565:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752572:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951666.752577:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752584:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752597:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951666.752600:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951666.752605:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.752612:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed064 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.752687:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:11514:x1870608602317568:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 293us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951666.752695:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:3.0:1783951666.759071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951666.759693:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602317824 00000100:00100000:1.0:1783951666.759703:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602317824 00000100:00100000:1.0:1783951666.759760:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:1.0:1783951666.759770:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:11514:x1870608602317824:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951666.760030:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:11514:x1870608602317824:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 260us (966us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1783951666.760038:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1783951666.804317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951666.804970:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602318080 00000100:00100000:0.0:1783951666.804980:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602318080 00000100:00100000:2.0:1783951666.805210:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 191 00000100:00100000:2.0:1783951666.805222:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:11049:x1870608602318080:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951666.805247:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951666.805267:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eed06b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388eb expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.805365:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.805391:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 28 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.805400:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.805440:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 28 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.805453:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 28 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951666.805467:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624330496:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951666.805552:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d517d06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951666.814300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.814599:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602318208 00000100:00100000:3.0:1783951666.814619:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602318208 00010000:00010000:3.0:1783951666.814658:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 29 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.814700:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:3.0:1783951666.814709:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:2358:x1870608602318208:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951666.814725:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951666.814732:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 29 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.814745:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 29 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.814765:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951666.814771:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.814781:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.814788:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.814806:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951666.814909:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:2358:x1870608602318208:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 200us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951666.814917:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00010000:00010000:2.0:1783951666.815385:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388e4 expref: 28 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951666.815402:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624330496:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951666.815429:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.815438:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.815444:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951666.815461:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783951666.815611:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f400/0x443dabd358eed06b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.815625:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.815633:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:2.0:1783951666.815636:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783951666.815638:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:2.0:1783951666.815674:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:11049:x1870608602318080:12345-192.168.201.6@tcp:101:bash.0 Request processed in 10455us (11366us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783951666.815680:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 191 00000100:00100000:1.0:1783951666.822786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.822952:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602318464 00000100:00100000:3.0:1783951666.822964:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602318464 00000100:00100000:3.0:1783951666.823055:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 192 00000100:00100000:3.0:1783951666.823064:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:11049:x1870608602318464:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:3.0:1783951666.823391:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.823408:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.823635:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951666.823695:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1783951666.823720:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009d587a1 reply state 000000004e716e60 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951666.823730:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783951666.823779:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1783951666.823921:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:11049:x1870608602318464:12345-192.168.201.6@tcp:36:bash.0 Request processed in 856us (1146us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1783951666.823930:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 192 00000020:00080000:3.0:1783951666.823935:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783951666.827154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.827687:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602318592 00000100:00100000:3.0:1783951666.827697:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602318592 00000100:00100000:3.0:1783951666.827750:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 193 00000100:00100000:3.0:1783951666.827761:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:11049:x1870608602318592:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1783951666.827783:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951666.827805:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed087 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388f2 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.827914:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed087 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f2 expref: 33 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.827944:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed087 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f2 expref: 33 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951666.827966:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951666.827969:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951666.827973:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff8c00, rc 0) 00000100:00100000:3.0:1783951666.828021:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+33:11049:x1870608602318592:12345-192.168.201.6@tcp:101:bash.0 Request processed in 262us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951666.828028:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 193 00000100:00100000:0.0:1783951666.831025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:1.0:1783951666.831217:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.831241:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.831248:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.831253:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40030c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951666.831258:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.831265:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.831281:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:1.0:1783951666.831284:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951666.831290:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951666.831296:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d40030c00/0x443dabd358eed080 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951666.831482:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602318720 00000100:00100000:2.0:1783951666.831490:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602318720 00000100:00100000:2.0:1783951666.831584:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1783951666.831595:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:11049:x1870608602318720:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951666.831613:0:8067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951666.831632:0:8067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0388f9 expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951666.831664:0:8067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a54f131, atime: 0x6a54f12f, ctime: 0x6a54f131, blocks: 0xb 00010000:00010000:2.0:1783951666.831685:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1783951666.831690:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951666.831699:0:8067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 8 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.831716:0:8067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 8 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.831729:0:8067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165f400, rc 0) 00000100:00100000:2.0:1783951666.831793:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:11049:x1870608602318720:12345-192.168.201.6@tcp:101:bash.0 Request processed in 200us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951666.831801:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:0.0:1783951666.834242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951666.834335:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602318848 00000100:00100000:3.0:1783951666.834343:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602318848 00002000:00010000:3.0:1783951666.834487:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1783951666.834492:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d759a3480 with x1870608602318848 ext(0->18446744073709551615) 00002000:00010000:3.0:1783951666.834504:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d759a3480. 00000100:00100000:3.0:1783951666.834581:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1783951666.834591:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2360:x1870608602318848:12345-192.168.201.6@tcp:10:bash.0 00002000:00010000:3.0:1783951666.834891:0:6596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783951666.834895:0:6596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783951665 -> 1783951667 00002000:00010000:3.0:1783951666.834898:0:6596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1783951663 -> 1783951663 00002000:00010000:3.0:1783951666.834901:0:6596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783951665 -> 1783951667 00002000:00010000:3.0:1783951666.834904:0:6596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1783951666.834957:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2360:x1870608602318848:12345-192.168.201.6@tcp:10:bash.0 Request processed in 367us (720us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1783951666.834966:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00002000:00010000:3.0:1783951666.834969:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1783951666.834985:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d759a3480 with x1870608602318848 ext(0->18446744073709551615) 00002000:00010000:3.0:1783951666.834990:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d759a3480. 00000100:00100000:3.0:1783951666.957406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951666.958129:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602318976 00000100:00100000:2.0:1783951666.958139:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602318976 00000100:00100000:2.0:1783951666.958203:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:2.0:1783951666.958213:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:11528:x1870608602318976:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:2.0:1783951666.958291:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958308:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958333:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958348:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958354:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958360:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958677:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958686:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958693:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951666.958747:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958760:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958767:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958774:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958791:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951666.958795:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958803:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958857:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951666.958861:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951666.958880:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958887:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958899:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958906:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958912:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958917:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951666.958920:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958926:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958945:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d44e70200) 00010000:00010000:2.0:1783951666.958947:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951666.958950:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958955:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed09c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958970:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958975:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958980:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958984:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951666.958986:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958992:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.958998:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:2.0:1783951666.959000:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951666.959002:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951666.959008:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951666.959084:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:11528:x1870608602318976:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 871us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951666.959091:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:0.0:1783951667.009918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951667.010002:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602319232 00000100:00100000:3.0:1783951667.010012:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602319232 00000100:00100000:3.0:1783951667.010073:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 195 00000100:00100000:3.0:1783951667.010084:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+32:11531:x1870608602319232:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951667.010107:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951667.010128:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038900 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010193:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010207:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010218:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010232:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010238:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010244:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010850:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed0bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010876:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010884:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951667.010894:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783951667.010992:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.010999:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011006:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011012:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951667.011016:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011024:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011035:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951667.011038:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951667.011042:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011048:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed0b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011059:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011070:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011075:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011080:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951667.011083:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011089:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011097:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf700) 00010000:00010000:3.0:1783951667.011100:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951667.011102:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011108:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011149:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038900 expref: 35 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011162:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed0bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038900 expref: 34 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.011169:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951667.011172:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783951667.011180:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d74ff9800, rc 0) 00000100:00100000:3.0:1783951667.011247:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:11531:x1870608602319232:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1164us (1338us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1783951667.011254:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 195 00000100:00100000:0.0:1783951667.016304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.016479:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602319360 00000100:00100000:2.0:1783951667.016487:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602319360 00000100:00100000:2.0:1783951667.016547:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:2.0:1783951667.016557:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:11531:x1870608602319360:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1783951667.016620:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.016636:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 34 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.016647:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.016676:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 34 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.016688:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 34 pid: 5791 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951667.016702:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624330624:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951667.016782:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d517d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951667.019406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951667.019508:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624330624:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951667.019533:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951667.019604:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602319616 00000100:00100000:1.0:1783951667.019611:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602319616 00000100:00100000:1.0:1783951667.019668:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:1.0:1783951667.019679:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:5574:x1870608602319616:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783951667.020047:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:5574:x1870608602319616:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 368us (647us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1783951667.020055:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1783951667.021999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951667.022073:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602319744 00000100:00100000:1.0:1783951667.022094:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602319744 00010000:00010000:1.0:1783951667.022129:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 36 pid: 5791 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951667.022166:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:1.0:1783951667.022176:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:2358:x1870608602319744:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951667.022189:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951667.022196:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 36 pid: 5791 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.022208:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 36 pid: 5791 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.022229:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed072 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388eb expref: 36 pid: 5791 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.022257:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:1.0:1783951667.022261:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.022272:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.022279:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.022313:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951667.022363:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:2358:x1870608602319744:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 189us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951667.022386:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00010000:00010000:2.0:1783951667.023224:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.023244:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.023277:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.023284:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.023290:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.023296:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.023300:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.023307:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.023317:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:2.0:1783951667.023320:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951667.023323:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.023329:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951667.023387:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:11531:x1870608602319360:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 6830us (7090us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951667.023396:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:0.0:1783951667.035455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951667.035532:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602320000 00000100:00100000:1.0:1783951667.035541:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602320000 00000100:00100000:1.0:1783951667.035592:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:1.0:1783951667.035602:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8119ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+34:11531:x1870608602320000:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951667.035854:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8119ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:11531:x1870608602320000:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 252us (406us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1783951667.035862:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:0.0:1783951667.122637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.122744:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602320256 00000100:00100000:2.0:1783951667.122754:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602320256 00000100:00100000:2.0:1783951667.122852:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 197 00000100:00100000:2.0:1783951667.122875:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+35:11543:x1870608602320256:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:2.0:1783951667.122901:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951667.122922:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038907 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.122996:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123010:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123022:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123038:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123045:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123051:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123396:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123405:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123421:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951667.123431:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1783951667.123543:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123551:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123558:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123564:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.123568:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123575:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123586:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951667.123589:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951667.123594:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123600:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed0db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123610:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123616:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123626:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123631:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.123634:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123640:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123648:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d44e70200) 00010000:00010000:2.0:1783951667.123650:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951667.123652:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123657:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed0e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123697:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed0d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038907 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123711:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038907 expref: 37 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.123717:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:2.0:1783951667.123719:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951667.123721:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165ec00, rc 0) 00000100:00100000:2.0:1783951667.123789:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:11543:x1870608602320256:12345-192.168.201.6@tcp:101:cat.0 Request processed in 928us (1163us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1783951667.123805:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 197 00000100:00100000:0.0:1783951667.133791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951667.133924:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602320512 00000100:00100000:1.0:1783951667.133934:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602320512 00000100:00100000:1.0:1783951667.133994:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1783951667.134005:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:11543:x1870608602320512:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:1.0:1783951667.134260:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+38:11543:x1870608602320512:12345-192.168.201.6@tcp:35:cat.0 Request processed in 256us (476us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1783951667.134268:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:0.0:1783951667.183146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951667.183244:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602320768 00000100:00100000:3.0:1783951667.183255:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602320768 00000100:00100000:3.0:1783951667.183319:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 198 00000100:00100000:3.0:1783951667.183330:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+38:11544:x1870608602320768:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:3.0:1783951667.183405:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783951667.183762:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed0e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038907 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.183789:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9800/0x443dabd358eed0bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038900 expref: 37 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.183804:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8c00/0x443dabd358eed087 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f2 expref: 36 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.183923:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951667.183935:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951667.183959:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.183973:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.183998:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.184013:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.184020:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.184027:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.184335:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.184344:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.184351:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951667.188176:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1783951667.188193:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384093382037ns, next at 385093378494ns, rc = 0 00010000:00010000:3.0:1783951667.188281:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.188300:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.188312:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.188332:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.188339:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.188346:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190706:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951667.190750:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190762:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190768:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190774:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951667.190779:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190786:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190801:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:3.0:1783951667.190804:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783951667.190824:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190850:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8600/0x443dabd358eed105 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190988:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.190996:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.191001:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.191006:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951667.191009:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.191016:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.191025:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951667.191027:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951667.191030:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.191036:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8200/0x443dabd358eed0f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951667.191046:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e33b3d0 reply state 00000000069b55b2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951667.191055:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951667.191164:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+37:11544:x1870608602320768:12345-192.168.201.6@tcp:36:rm.0 Request processed in 7832us (8025us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1783951667.191173:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 198 00010000:00010000:3.0:1783951667.195908:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.195927:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.195935:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.195942:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951667.195947:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.195955:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.195972:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf700) 00010000:00010000:3.0:1783951667.195975:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951667.195981:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.195987:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8400/0x443dabd358eed0fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.198008:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951667.198021:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.198031:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfde00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951667.198036:0:8310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.198044:0:8310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.198061:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8d821cf600) 00010000:00010000:2.0:1783951667.198064:0:8310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783951667.198068:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.198073:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed10c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.198095:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951667.198097:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951667.198098:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951667.297494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.297698:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602321024 00000100:00100000:2.0:1783951667.297709:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602321024 00000100:00100000:2.0:1783951667.297845:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 199 00000100:00100000:2.0:1783951667.297857:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+36:11550:x1870608602321024:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951667.297892:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951667.297913:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed113 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03890e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.298455:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.298472:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.298484:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.298499:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.298506:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.298512:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783951667.299079:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1783951667.299250:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299259:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299268:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299306:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299324:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299331:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299338:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.299342:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299350:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299363:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951667.299365:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951667.299370:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299376:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed11a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951667.299390:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007322ebc0 reply state 000000006aa68f83 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951667.299399:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783951667.299430:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed113 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299444:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.299464:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70900) 00010000:00010000:2.0:1783951667.299467:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951667.299469:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165ec00, rc 0) 00000100:00100000:2.0:1783951667.299558:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:11550:x1870608602321024:12345-192.168.201.6@tcp:101:bash.0 Request processed in 1703us (2072us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1783951667.299566:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 199 00010000:00010000:1.0:1783951667.302328:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.302345:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.302353:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.302367:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951667.302373:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.302396:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.302419:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d44e70200) 00010000:00010000:1.0:1783951667.302422:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951667.302426:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.302433:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed121 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951667.305386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.305466:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602321152 00000100:00100000:2.0:1783951667.305476:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602321152 00000100:00100000:2.0:1783951667.305548:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1783951667.305567:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2359:x1870608602321152:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951667.305595:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951667.305618:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038915 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951667.305646:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951667.305668:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1783951667.305672:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951667.305683:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.305702:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.305716:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d41512600, rc 0) 00000100:00100000:2.0:1783951667.305776:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2359:x1870608602321152:12345-192.168.201.6@tcp:101:bash.0 Request processed in 219us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951667.305790:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00080000:3.0:1783951667.306212:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951667.326295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951667.326401:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602321280 00000100:00100000:1.0:1783951667.326418:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602321280 00000100:00100000:1.0:1783951667.326476:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:1.0:1783951667.326486:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:11550:x1870608602321280:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951667.326505:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951667.326522:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03891c expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.326564:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.326574:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951667.326580:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951667.326591:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.326628:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.326656:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 7 pid: 6589 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951667.326672:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c420c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1870608624330752:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951667.326763:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d434d4600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951667.332333:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c420c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1870608624330752:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951667.332382:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.332410:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28400, rc 0) 00000100:00100000:2.0:1783951667.332469:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:11550:x1870608602321280:12345-192.168.201.6@tcp:101:bash.0 Request processed in 5983us (6183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951667.332477:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:0.0:1783951667.333796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951667.334084:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602321408 00000100:00100000:3.0:1783951667.334093:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602321408 00010000:00010000:3.0:1783951667.334134:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 7 pid: 6589 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951667.334196:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:3.0:1783951667.334206:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602321408:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951667.334221:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951667.334250:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 7 pid: 6589 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.334264:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 7 pid: 6589 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.334288:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000719ce488/0x443dabd358eed136 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038915 expref: 7 pid: 6589 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.334309:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951667.334314:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951667.334322:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.334332:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951667.334383:0:5776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951667.334398:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f618380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5776:1870608624330880:192.168.201.6@tcp:105: 00000100:00100000:3.0:1783951667.336765:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951667.341424:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f618380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5776:1870608624330880:192.168.201.6@tcp:105: 00010000:00010000:3.0:1783951667.341456:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951667.341515:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2358:x1870608602321408:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 7309us (7723us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951667.341525:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:1.0:1783951667.342737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951667.342834:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602321664 00000100:00100000:0.0:1783951667.342981:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602321664 00000100:00100000:0.0:1783951667.343034:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:0.0:1783951667.343043:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+38:11550:x1870608602321664:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:0.0:1783951667.343379:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:11550:x1870608602321664:12345-192.168.201.6@tcp:35:bash.0 Request processed in 336us (646us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783951667.343387:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00010000:00010000:0.0:1783951667.446035:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951667.585695:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c420c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624331008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951667.585789:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951667.587718:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624331008 00000100:00100000:1.0:1783951667.587731:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624331008 00000100:00100000:1.0:1783951667.587852:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783951667.587874:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624331008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951667.587922:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951667.588012:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624331008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951667.588020:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1783951667.588589:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951667.588655:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c420c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624331008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951667.610051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951667.610779:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602321792 00000100:00100000:1.0:1783951667.610790:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602321792 00000100:00100000:1.0:1783951667.611029:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:1.0:1783951667.611041:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+39:11566:x1870608602321792:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951667.611064:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951667.611084:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eed144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038923 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.611220:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eed14b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.611250:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eed14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.611261:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eed14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951667.611323:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1783951667.611326:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951667.611345:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eed14b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.611369:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eed144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038923 expref: 41 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.611386:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eed14b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038923 expref: 40 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.611395:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:1.0:1783951667.611398:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951667.611401:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28000, rc 0) 00000100:00100000:1.0:1783951667.611457:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:11566:x1870608602321792:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 420us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951667.611463:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:1.0:1783951667.627614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951667.628738:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602322048 00000100:00100000:3.0:1783951667.628750:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602322048 00000100:00100000:2.0:1783951667.629059:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 201 00000100:00100000:2.0:1783951667.629072:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+40:11566:x1870608602322048:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951667.629095:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951667.629118:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41513a00/0x443dabd358eed152 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03892a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.629216:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.629231:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.629242:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951667.629253:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783951667.629382:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41513a00/0x443dabd358eed152 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03892a expref: 43 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.629417:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03892a expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.629427:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70900) 00010000:00010000:2.0:1783951667.629430:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951667.629433:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d41512600, rc 0) 00000100:00100000:2.0:1783951667.629498:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+42:11566:x1870608602322048:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 429us (1894us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783951667.629505:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 201 00000100:00100000:3.0:1783951667.636633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951667.636685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951667.637291:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602322304 00000100:00100000:1.0:1783951667.637301:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602322304 00000100:00100000:1.0:1783951667.637369:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:1.0:1783951667.637379:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+42:11566:x1870608602322304:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951667.637416:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951667.637435:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eed167 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038931 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.637533:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eed16e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.637548:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eed16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.637571:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eed16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951667.637583:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783951667.637711:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29e00/0x443dabd358eed167 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038931 expref: 45 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.637728:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eed16e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038931 expref: 44 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.637736:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70900) 00010000:00010000:1.0:1783951667.637739:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783951667.637742:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28200, rc 0) 00000100:00100000:1.0:1783951667.638325:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+44:11566:x1870608602322304:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 428us (1190us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1783951667.638336:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:0.0:1783951667.639160:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602322432 00000100:00100000:0.0:1783951667.639168:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602322432 00000100:00100000:0.0:1783951667.639228:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1783951667.639236:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+44:2358:x1870608602322432:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951667.639249:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951667.639267:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03892a expref: 44 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.639283:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70900) 00010000:00010000:0.0:1783951667.639287:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951667.639328:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:2358:x1870608602322432:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 93us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951667.639335:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783951667.645159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.645285:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602322560 00000100:00100000:2.0:1783951667.645296:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602322560 00000100:00100000:2.0:1783951667.645351:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1783951667.645360:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+6:2360:x1870608602322560:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:2.0:1783951667.645408:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.645431:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.645440:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951667.645444:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951667.645450:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.645485:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.645515:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 6 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951667.645531:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1870608624331136:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951667.646190:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d517d06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951667.649553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951667.649868:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602322688 00000100:00100000:1.0:1783951667.649879:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602322688 00002000:00100000:1.0:1783951667.649936:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e8d74ef3b80 x1870608602322688/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:683/0 lens 504/0 e 0 to 0 dl 1783951678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951667.649962:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d74ef3b80 with x1870608602322688 ext(0->8) 00010000:00010000:1.0:1783951667.649973:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 7 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.649991:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 7 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951667.649999:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8d74ef3b80 00000100:00100000:1.0:1783951667.650032:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1783951667.650043:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602322688:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:2.0:1783951667.650490:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1870608624331136:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951667.650515:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951667.653869:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2359:x1870608602322688:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 3810us (4307us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783951667.653881:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00002000:00100000:1.0:1783951667.653894:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e8d74ef3b80 x1870608602322688/t4294967308(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:683/0 lens 504/448 e 0 to 0 dl 1783951678 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951667.653904:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d74ef3b80 with x1870608602322688 ext(0->8) 00010000:00010000:1.0:1783951667.653914:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 9 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951667.653933:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 9 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951667.653942:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8d74ef3b80 00000100:00100000:1.0:1783951667.663698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.664628:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602322816 00000100:00100000:2.0:1783951667.664641:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602322816 00010000:00010000:2.0:1783951667.664690:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 9 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951667.664742:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:2.0:1783951667.664753:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2358:x1870608602322816:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951667.664770:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783951667.665003:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783951667.665006:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783951667 00002000:00010000:2.0:1783951667.665008:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783951667 00002000:00010000:2.0:1783951667.665011:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783951667 00010000:00010000:2.0:1783951667.665018:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 9 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.665048:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 9 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.665071:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee5a9451/0x443dabd358eed13d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03891c expref: 9 pid: 6591 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.665087:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951667.665097:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951667.665105:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.665115:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.665154:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951667.665230:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602322816:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 479us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951667.665238:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00010000:00010000:0.0:1783951667.665308:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.665319:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.665344:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.665372:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.665382:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.665402:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41513a00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951667.665407:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.665416:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.665428:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.665435:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000556c592/0x443dabd358eed17c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951667.665480:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2360:x1870608602322560:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 20120us (20331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951667.665487:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:1.0:1783951667.673631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951667.673711:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602323072 00000100:00100000:0.0:1783951667.673721:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602323072 00000100:00100000:0.0:1783951667.673787:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:0.0:1783951667.673797:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d601d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+43:11566:x1870608602323072:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:0.0:1783951667.673910:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eed16e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038931 expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951667.674525:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1783951667.674582:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1783951667.676067:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1783951667.676427:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.676448:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.676456:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.676494:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.676509:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 47 pid: 5791 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951667.676525:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1870608624331264:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951667.676655:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951667.685631:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.686092:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602323200 00000100:00100000:2.0:1783951667.686100:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602323200 00010000:00010000:2.0:1783951667.686139:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 48 pid: 5791 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951667.686238:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1870608624331264:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951667.686259:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951667.686306:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:2.0:1783951667.686315:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+48:2359:x1870608602323200:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951667.686345:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951667.686372:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 48 pid: 5791 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.686384:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 48 pid: 5791 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.686407:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03890e expref: 48 pid: 5791 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.686424:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70900) 00010000:00010000:2.0:1783951667.686429:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.686438:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.686445:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.686473:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951667.686532:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+47:2359:x1870608602323200:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 218us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951667.686540:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00010000:00010000:0.0:1783951667.686758:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.686766:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951667.686959:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1783951667.687172:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1783951667.687276:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624331392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783951667.687317:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951667.687354:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0540 going to sleep for 11 seconds 00000100:00100000:3.0:1783951667.687637:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624331392 00000100:00100000:3.0:1783951667.687643:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624331392 00000100:00100000:3.0:1783951667.690297:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951667.690315:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1870608624331392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783951667.690795:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1870608624331392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 486us (3476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951667.690803:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1783951667.691062:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951667.692230:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624331392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783951667.693249:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1783951667.693341:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d74ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624331520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783951667.693699:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951667.693793:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951667.694141:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624331520 00000100:00100000:2.0:1783951667.694150:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624331520 00000100:00100000:2.0:1783951667.694193:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783951667.694203:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1870608624331520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783951667.694603:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5794:x1870608624331520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 401us (904us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783951667.694730:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d74ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1870608624331520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783951667.694999:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1783951667.695065:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.695077:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.695085:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.695093:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5a00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951667.695097:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.695105:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.695121:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70900) 00010000:00010000:0.0:1783951667.695125:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783951667.695129:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951667.695142:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed183 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951667.695326:0:5794:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783951667.696164:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1783951667.696177:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384601366335ns, next at 385601364058ns, rc = 0 00000001:00080000:0.0:1783951667.696186:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1783951667.696225:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70900) 00010000:00010000:0.0:1783951667.696229:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783951667.696238:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28200/0x443dabd358eed16e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038931 expref: 51 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951667.696346:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d601d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:11566:x1870608602323072:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 22549us (22723us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1783951667.696463:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783951667.696683:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000020:00080000:0.0:1783951667.696688:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783951667.701561:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.701638:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602323328 00000100:00100000:2.0:1783951667.701648:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602323328 00000100:00100000:2.0:1783951667.701705:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 203 00000100:00100000:2.0:1783951667.701715:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+50:11566:x1870608602323328:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951667.701742:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951667.701765:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41513a00/0x443dabd358eed18a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038938 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.701876:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41513a00/0x443dabd358eed18a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038938 expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.701891:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41513a00/0x443dabd358eed18a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038938 expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.701913:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951667.701916:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951667.701920:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d41513a00, rc 0) 00000100:00100000:2.0:1783951667.701981:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+51:11566:x1870608602323328:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 267us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951667.701988:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 203 00000100:00100000:0.0:1783951667.704760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951667.704844:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602323584 00000100:00100000:3.0:1783951667.704861:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602323584 00000100:00100000:3.0:1783951667.704909:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:3.0:1783951667.704932:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+51:11566:x1870608602323584:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951667.705163:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:11566:x1870608602323584:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 233us (411us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1783951667.705171:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1783951667.807059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.807166:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602323712 00000100:00100000:2.0:1783951667.807175:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602323712 00000100:00100000:2.0:1783951667.807221:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:2.0:1783951667.807228:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:11576:x1870608602323712:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:2.0:1783951667.807288:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807312:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807320:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807333:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807337:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807341:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807441:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807446:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807450:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951667.807482:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807490:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807494:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807506:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807511:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41512600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.807513:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807518:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807527:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951667.807529:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951667.807533:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807537:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807670:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807677:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807682:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807687:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.807690:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807706:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807714:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d44e70800) 00010000:00010000:2.0:1783951667.807717:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951667.807720:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807725:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807739:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807745:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807750:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807755:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.807757:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807762:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807768:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951667.807770:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951667.807772:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.807788:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed19f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951667.807930:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:11576:x1870608602323712:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 701us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951667.807938:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:1.0:1783951667.884338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.884689:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602323968 00000100:00100000:2.0:1783951667.884702:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602323968 00000100:00100000:2.0:1783951667.884778:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 205 00000100:00100000:2.0:1783951667.884790:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+52:11579:x1870608602323968:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951667.884995:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951667.885018:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed1a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03893f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885096:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885111:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885123:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885137:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885143:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885149:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885307:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed1bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885316:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.885323:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951667.885333:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783951667.886948:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.886964:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.886972:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.886977:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.886982:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.886988:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887003:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:2.0:1783951667.887006:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951667.887011:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887032:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed1ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887047:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887053:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887058:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887063:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.887066:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887072:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887079:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d44e70800) 00010000:00010000:2.0:1783951667.887081:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951667.887084:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887089:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887142:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed1a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03893f expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887156:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed1bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03893f expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.887169:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951667.887172:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951667.887174:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:2.0:1783951667.888012:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:11579:x1870608602323968:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 3220us (3679us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783951667.888022:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 205 00000100:00100000:0.0:1783951667.893299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951667.893385:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602324096 00000100:00100000:2.0:1783951667.893395:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602324096 00000100:00100000:2.0:1783951667.893457:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:2.0:1783951667.893469:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:11579:x1870608602324096:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1783951667.893555:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893572:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893584:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893615:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893621:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893629:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893636:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41512600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951667.893656:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893664:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893677:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951667.893680:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951667.893684:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951667.893691:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951667.893770:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:11579:x1870608602324096:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 303us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951667.893778:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:1.0:1783951667.900462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951667.900711:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602324352 00000100:00100000:3.0:1783951667.900723:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602324352 00000100:00100000:3.0:1783951667.900791:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:3.0:1783951667.900803:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+54:11579:x1870608602324352:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1783951667.901138:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:11579:x1870608602324352:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 336us (686us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1783951667.901146:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:1.0:1783951668.037915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951668.038002:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602324608 00000100:00100000:3.0:1783951668.038012:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602324608 00000100:00100000:3.0:1783951668.038096:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 207 00000100:00100000:3.0:1783951668.038107:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+55:11589:x1870608602324608:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1783951668.038142:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951668.038146:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783951668.038172:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28000/0x443dabd358eed14b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038923 expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.038193:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951668.038197:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951668.038210:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfcc00/0x443dabd358eed1d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038946 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.038307:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed1d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.038333:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.038343:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951668.038364:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00080000:0.0:1783951668.038501:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951668.038726:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfcc00/0x443dabd358eed1d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038946 expref: 57 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.038742:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038946 expref: 56 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.038749:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:3.0:1783951668.038752:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951668.038755:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfda00, rc 0) 00000100:00100000:3.0:1783951668.038896:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:11589:x1870608602324608:12345-192.168.201.6@tcp:101:bash.0 Request processed in 790us (989us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1783951668.038904:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 207 00000100:00100000:1.0:1783951668.044998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951668.045684:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602324864 00000100:00100000:2.0:1783951668.045695:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602324864 00000100:00100000:2.0:1783951668.045763:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:2.0:1783951668.045775:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:11589:x1870608602324864:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:2.0:1783951668.045895:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783951668.045923:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed1d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038946 expref: 56 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.045947:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed1bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03893f expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.045958:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951668.045975:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951668.046205:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.046218:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.046228:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951668.046283:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1783951668.046311:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056a14d28 reply state 0000000058aff49f transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951668.046320:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951668.046415:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:11589:x1870608602324864:12345-192.168.201.6@tcp:36:bash.0 Request processed in 642us (1427us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1783951668.046423:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 208 00000020:00080000:2.0:1783951668.046427:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783951668.050046:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.050068:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.050076:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.050083:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41512600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951668.050103:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.050112:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.050141:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:3.0:1783951668.050145:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951668.050151:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.050157:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41512600/0x443dabd358eed1e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951668.050267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951668.050515:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602324992 00000100:00100000:2.0:1783951668.050524:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602324992 00000100:00100000:2.0:1783951668.050584:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:2.0:1783951668.050594:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+56:11589:x1870608602324992:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951668.050726:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951668.050746:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed1ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03894d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.050864:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.050877:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.050892:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951668.050919:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783951668.050922:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951668.050937:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.050956:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed1ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 58 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.050966:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.050971:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951668.050973:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951668.050975:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:2.0:1783951668.051031:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:11589:x1870608602324992:12345-192.168.201.6@tcp:101:bash.0 Request processed in 440us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951668.051036:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:1.0:1783951668.053760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951668.053803:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602325248 00000100:00100000:3.0:1783951668.053832:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602325248 00000100:00100000:3.0:1783951668.053896:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1783951668.053907:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+57:11589:x1870608602325248:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:3.0:1783951668.054194:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+58:11589:x1870608602325248:12345-192.168.201.6@tcp:35:bash.0 Request processed in 288us (440us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1783951668.054202:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:1.0:1783951668.124264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951668.124382:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602325376 00000100:00100000:3.0:1783951668.124392:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602325376 00000100:00100000:3.0:1783951668.124459:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:3.0:1783951668.124471:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+58:11595:x1870608602325376:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951668.124497:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951668.124520:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfcc00/0x443dabd358eed1fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038954 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.124610:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd000/0x443dabd358eed201 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.124625:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd000/0x443dabd358eed201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.124639:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd000/0x443dabd358eed201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951668.124707:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783951668.124711:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951668.124735:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd000/0x443dabd358eed201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.124762:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfcc00/0x443dabd358eed1fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038954 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.124781:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd000/0x443dabd358eed201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038954 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.124790:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951668.124793:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951668.124797:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfd000, rc 0) 00000100:00100000:3.0:1783951668.124917:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:11595:x1870608602325376:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 448us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951668.124925:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:1.0:1783951668.132021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951668.134955:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602325504 00000100:00100000:3.0:1783951668.134971:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602325504 00000100:00100000:3.0:1783951668.135132:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:3.0:1783951668.135142:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:11595:x1870608602325504:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951668.135165:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951668.135185:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfcc00/0x443dabd358eed208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03895b expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135455:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135473:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135486:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135503:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135511:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135518:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135648:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135658:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135665:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951668.135717:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783951668.135721:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951668.135739:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135751:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135759:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135764:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135771:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135776:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfce00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951668.135780:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135787:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135837:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951668.135840:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951668.135854:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135862:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed20f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135887:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135893:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135899:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135904:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfca00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951668.135906:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135912:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135920:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf700) 00010000:00010000:3.0:1783951668.135922:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951668.135925:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135931:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135963:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfcc00/0x443dabd358eed208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 61 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135975:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.135993:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:3.0:1783951668.135995:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951668.135997:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfd200, rc 0) 00000100:00100000:3.0:1783951668.136080:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11595:x1870608602325504:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 940us (4073us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951668.136088:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:1.0:1783951668.150731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951668.150778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951668.150900:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602325760 00000100:00100000:3.0:1783951668.150911:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602325760 00000100:00100000:3.0:1783951668.150971:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:3.0:1783951668.150983:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c4371d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11595:x1870608602325760:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951668.151005:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951668.151027:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfcc00/0x443dabd358eed224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038962 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.151155:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.151173:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.151181:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 61 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.151190:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.151230:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 61 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.151260:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 61 pid: 8068 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951668.151275:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f61a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624331648:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951668.151427:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.151436:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 61 pid: 5791 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951668.151446:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f618700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624331776:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951668.151474:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951668.151895:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602325888 00000100:00100000:2.0:1783951668.151902:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602325888 00010000:00010000:2.0:1783951668.151932:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 62 pid: 8068 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951668.151967:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:2.0:1783951668.151976:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+62:2359:x1870608602325888:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951668.152000:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951668.152007:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 62 pid: 8068 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.152019:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 62 pid: 8068 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.152037:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951668.152041:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.152048:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.152055:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951668.152139:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+62:2359:x1870608602325888:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 163us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951668.152150:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:1.0:1783951668.166759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951668.167131:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602326016 00000100:00100000:2.0:1783951668.167140:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602326016 00010000:00010000:2.0:1783951668.167184:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 62 pid: 5791 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951668.167231:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:2.0:1783951668.167246:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+62:2358:x1870608602326016:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951668.167291:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951668.167299:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 62 pid: 5791 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.167324:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 62 pid: 5791 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.167551:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951668.167558:0:8312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.167570:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.167578:0:8312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.167599:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951668.167670:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+62:2358:x1870608602326016:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 425us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951668.167678:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00010000:00010000:3.0:1783951668.168433:0:5792:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.6@tcp) returned -22 from blocking AST (req@0000000028aabd92 x1870608624331648) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 61 pid: 8068 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951668.168450:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed21d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03895b expref: 61 pid: 8068 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951668.168466:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f61a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624331648:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951668.168602:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed1f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03894d expref: 60 pid: 5791 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951668.168682:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f618700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1870608624331776:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951668.168707:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951668.168714:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.168724:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.168747:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951668.168770:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783951668.169241:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfcc00/0x443dabd358eed224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 61 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.169258:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.169266:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951668.169268:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783951668.169270:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfca00, rc 0) 00000100:00100000:2.0:1783951668.169366:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c4371d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11595:x1870608602325760:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 18385us (18643us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783951668.169374:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:1.0:1783951668.174959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951668.175062:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602326272 00000100:00100000:2.0:1783951668.175072:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602326272 00000100:00100000:2.0:1783951668.175157:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1783951668.175169:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11595:x1870608602326272:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:2.0:1783951668.175186:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951668.175221:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d41513a00/0x443dabd358eed18a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038938 expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.175242:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951668.175248:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951668.175317:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:11595:x1870608602326272:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 149us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951668.175326:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:0.0:1783951668.178500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951668.178645:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602326400 00000100:00100000:2.0:1783951668.178658:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602326400 00000100:00100000:2.0:1783951668.178734:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:2.0:1783951668.178747:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:11595:x1870608602326400:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:2.0:1783951668.178902:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.178920:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951668.178933:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951668.182067:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1783951668.182517:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:11595:x1870608602326400:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 3765us (4021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951668.182530:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:0.0:1783951668.188573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951668.188642:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602326528 00000100:00100000:1.0:1783951668.188651:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602326528 00000100:00100000:1.0:1783951668.188734:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:1.0:1783951668.188743:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+59:11595:x1870608602326528:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951668.188762:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951668.188777:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038969 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951668.188881:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951668.188892:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038969 expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951668.188924:0:5793:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951668.188936:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038969 expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951668.188946:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:1.0:1783951668.188948:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951668.188950:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038969 expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951668.188955:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28800, rc 0) 00000100:00100000:1.0:1783951668.189006:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11595:x1870608602326528:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 263us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951668.189012:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 214 00010000:00010000:2.0:1783951668.470037:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951668.598232:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951668.598334:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624332288:0@lo:400:kworker.0 00000100:00100000:1.0:1783951668.598334:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624332032:0@lo:400:kworker.0 00000100:00100000:3.0:1783951668.598490:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951668.598542:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624331904:0@lo:400:kworker.0 00000100:00100000:3.0:1783951668.598583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951668.598632:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624332416:0@lo:400:kworker.0 00000100:00100000:0.0:1783951668.598671:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951668.599219:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624332288 00000100:00100000:3.0:1783951668.599228:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624332288 00000100:00100000:0.0:1783951668.601618:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624331904 00000100:00100000:0.0:1783951668.601634:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624331904 00000100:00100000:0.0:1783951668.601702:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1783951668.601716:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624331904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951668.601826:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624331904:12345-0@lo:400:kworker.0 Request processed in 115us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951668.601834:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1783951668.601898:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d79bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624332160:0@lo:400:kworker.0 00000100:00100000:0.0:1783951668.601951:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951668.601999:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624332416 00000100:00100000:0.0:1783951668.602004:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624332416 00000100:00080000:0.0:1783951668.602030:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951668.602055:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624332160 00000100:00100000:0.0:1783951668.602058:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624332160 00000100:00080000:0.0:1783951668.602071:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951668.602091:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783951668.602098:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624332416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951668.602139:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624332416:12345-0@lo:400:kworker.0 Request processed in 36us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951668.602149:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783951668.602194:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624332416:0@lo:400:kworker.0 00000100:00100000:0.0:1783951668.602223:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783951668.602233:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624332160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951668.602276:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624332160:12345-0@lo:400:kworker.0 Request processed in 47us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951668.602283:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783951668.602302:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624332160:0@lo:400:kworker.0 00000100:00100000:0.0:1783951668.602613:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624331904:0@lo:400:kworker.0 00000100:00100000:3.0:1783951668.603364:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783951668.603376:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624332288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951668.603512:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624332288:12345-0@lo:400:kworker.0 Request processed in 138us (5021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951668.603521:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783951668.603561:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624332288:0@lo:400:kworker.0 00000100:00100000:1.0:1783951668.603651:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951668.603682:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624332544:0@lo:400:kworker.0 00000100:00100000:1.0:1783951668.603709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951668.603743:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624332544 00000100:00100000:1.0:1783951668.603749:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624332544 00000100:00100000:1.0:1783951668.603779:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783951668.603787:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624332544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951668.603836:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624332544:12345-0@lo:400:kworker.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951668.603871:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783951668.603898:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624332032 00000100:00100000:3.0:1783951668.603904:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624332032 00000100:00100000:1.0:1783951668.603910:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624332544:0@lo:400:kworker.0 00000100:00100000:3.0:1783951668.603941:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783951668.603949:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624332032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951668.603993:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624332032:12345-0@lo:400:kworker.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951668.604127:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d79bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624332032:0@lo:400:kworker.0 00000100:00100000:3.0:1783951668.604223:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000001:00080000:3.0:1783951668.651901:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1783951668.652198:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1783951668.652523:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000004:00080000:1.0:1783951669.110185:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386015371746ns, next at 387015369197ns, rc = 0 00000100:00100000:0.0:1783951669.110256:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624332672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951669.110348:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951669.111022:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624332672 00000100:00100000:1.0:1783951669.111034:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624332672 00000100:00100000:1.0:1783951669.111109:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783951669.111120:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624332672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951669.111170:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951669.111254:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624332672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951669.111262:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783951669.111423:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1783951669.111429:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d79bdfb80, transno 4294967307 00000004:00080000:3.0:1783951669.111455:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1783951669.111484:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624332672:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783951669.111595:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1783951669.174122:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951669.174130:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951669.174948:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1783951669.174955:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951669.175072:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811d2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624332800:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951669.175211:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d60451480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951669.188023:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811d2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624332800:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783951669.193073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951669.193463:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602326656 00000100:00100000:1.0:1783951669.193473:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602326656 00000100:00100000:1.0:1783951669.193541:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:1.0:1783951669.193552:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11596:x1870608602326656:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783951669.193590:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783951669.193746:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11596:x1870608602326656:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 195us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951669.193754:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:0.0:1783951669.202001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951669.202202:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602326784 00000100:00100000:2.0:1783951669.202225:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602326784 00000100:00100000:2.0:1783951669.202290:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:2.0:1783951669.202300:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11596:x1870608602326784:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783951669.202373:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202389:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202403:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202420:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202426:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202432:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202455:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202463:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202471:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951669.202530:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783951669.202534:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951669.202553:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202565:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202572:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202579:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202586:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165fa00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951669.202591:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202598:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202611:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:2.0:1783951669.202614:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951669.202619:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202626:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fa00/0x443dabd358eed247 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202639:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202646:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202651:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202661:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165ec00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951669.202664:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202670:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202678:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e8d44e70800) 00010000:00010000:2.0:1783951669.202681:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951669.202683:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202688:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed24e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202703:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202709:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202714:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202719:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951669.202722:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202728:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202750:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951669.202753:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951669.202756:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.202762:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951669.202871:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11596:x1870608602326784:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 572us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.202880:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:2.0:1783951669.205002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951669.205082:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602327040 00000100:00100000:1.0:1783951669.205091:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602327040 00000100:00100000:1.0:1783951669.205147:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:1.0:1783951669.205157:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+60:11596:x1870608602327040:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951669.205188:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951669.205206:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed25c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038970 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.205380:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.205396:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.205407:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951669.205418:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783951669.206318:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.206384:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.206392:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.206399:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951669.206403:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.206410:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.206425:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:0.0:1783951669.206428:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951669.206432:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.206439:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.213200:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed25c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038970 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.213236:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:0.0:1783951669.213256:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951669.213262:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed25c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038970 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.213281:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29600, rc 0) 00000100:00100000:0.0:1783951669.213366:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:11596:x1870608602327040:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 8209us (8371us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1783951669.213375:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:0.0:1783951669.221854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951669.221963:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602327168 00000100:00100000:2.0:1783951669.221973:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602327168 00000100:00100000:2.0:1783951669.222032:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:2.0:1783951669.222042:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:11596:x1870608602327168:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951669.222078:0:8068:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951669.222344:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:11596:x1870608602327168:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 302us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.222353:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:1.0:1783951669.228649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951669.232353:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602327424 00000100:00100000:0.0:1783951669.232368:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602327424 00000100:00100000:0.0:1783951669.232448:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:0.0:1783951669.232458:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:11596:x1870608602327424:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951669.232758:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951669.232762:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783951669.232791:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd000/0x443dabd358eed201 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038954 expref: 61 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.232843:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:0.0:1783951669.232850:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951669.232864:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eed271 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038977 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951669.233454:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1783951669.241094:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed278 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.241113:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.241125:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.241191:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4c00/0x443dabd358eed271 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038977 expref: 63 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.241422:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038977 expref: 62 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.241434:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951669.241451:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951669.241455:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29600, rc 0) 00000100:00100000:1.0:1783951669.241622:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+62:11596:x1870608602327424:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 9162us (12980us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1783951669.241632:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:1.0:1783951669.245918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.246220:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602327680 00000100:00100000:3.0:1783951669.246232:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602327680 00000100:00100000:3.0:1783951669.246301:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 220 00000100:00100000:3.0:1783951669.246311:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+62:11596:x1870608602327680:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951669.246661:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951669.246687:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed278 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038977 expref: 62 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246706:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:3.0:1783951669.246727:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951669.246749:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246764:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246774:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246787:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246794:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246801:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246912:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246920:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246928:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246941:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfd200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951669.246946:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246954:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246962:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951669.246965:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951669.246969:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246975:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed286 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246985:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246991:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.246997:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.247002:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfce00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951669.247005:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.247011:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.247028:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe214af31 (ffff8e8d821cf400) 00010000:00010000:3.0:1783951669.247030:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951669.247034:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.247040:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed28d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe214af31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.247116:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:11596:x1870608602327680:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 805us (1207us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783951669.247125:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 220 00000100:00100000:0.0:1783951669.254961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951669.255054:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602327808 00000100:00100000:2.0:1783951669.255065:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602327808 00000100:00100000:2.0:1783951669.255125:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:2.0:1783951669.255135:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+61:11596:x1870608602327808:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951669.255156:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951669.255178:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed294 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03897e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.255628:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.255644:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.255656:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.255754:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 63 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.255773:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.255782:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:2.0:1783951669.255785:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783951669.255788:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165ec00, rc 0) 00000100:00100000:2.0:1783951669.255957:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+62:11596:x1870608602327808:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 822us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.255965:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:1.0:1783951669.262674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951669.263291:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602328064 00000100:00100000:0.0:1783951669.263300:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602328064 00000100:00100000:0.0:1783951669.263364:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 222 00000100:00100000:0.0:1783951669.263388:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+62:11596:x1870608602328064:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951669.263485:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.263502:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.263514:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951669.263781:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1783951669.263790:0:8068:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386168978888ns, next at 387168976498ns, rc = 0 00000004:00010000:0.0:1783951669.264137:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b629dc30 reply state 00000000a97350f0 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951669.264147:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951669.264430:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+64:11596:x1870608602328064:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1042us (1766us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1783951669.264438:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 222 00000100:00100000:1.0:1783951669.270005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951669.270101:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602328192 00000100:00100000:2.0:1783951669.270111:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602328192 00000100:00100000:2.0:1783951669.270173:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 223 00000100:00100000:2.0:1783951669.270183:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+64:11596:x1870608602328192:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951669.270207:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951669.270237:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038985 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.270553:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 65 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.270568:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 65 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.270589:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:2.0:1783951669.270593:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951669.270597:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165e600, rc 0) 00000100:00100000:2.0:1783951669.270660:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+65:11596:x1870608602328192:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 478us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.270668:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 223 00010000:00010000:0.0:1783951669.271470:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.271490:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.271498:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.271505:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951669.271510:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.271535:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.271548:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:0.0:1783951669.271551:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951669.271555:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.271561:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5c00/0x443dabd358eed2a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951669.284003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951669.284102:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602328320 00000100:00100000:0.0:1783951669.284113:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602328320 00000100:00100000:0.0:1783951669.284200:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:0.0:1783951669.284220:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2361:x1870608602328320:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783951669.285149:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:2361:x1870608602328320:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 936us (1154us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1783951669.285160:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00080000:2.0:1783951669.285245:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951669.297510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.297642:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602328576 00000100:00100000:3.0:1783951669.297651:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602328576 00000100:00100000:3.0:1783951669.297707:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:3.0:1783951669.297716:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+64:11596:x1870608602328576:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783951669.298011:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+65:11596:x1870608602328576:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 295us (510us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1783951669.298020:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:1.0:1783951669.304028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.304253:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602328832 00000100:00100000:3.0:1783951669.304263:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602328832 00000100:00100000:3.0:1783951669.304336:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 224 00000100:00100000:3.0:1783951669.304346:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+65:11596:x1870608602328832:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783951669.304475:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+65:11596:x1870608602328832:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 123us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951669.304484:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 224 00000100:00100000:1.0:1783951669.308098:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.308187:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602328960 00000100:00100000:3.0:1783951669.308219:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602328960 00000100:00100000:3.0:1783951669.308295:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:3.0:1783951669.308306:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+65:11596:x1870608602328960:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951669.308335:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951669.308358:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03898c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.308448:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.308462:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.308483:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951669.308898:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951669.308919:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.308947:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03898c expref: 67 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.308965:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03898c expref: 66 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.308974:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:3.0:1783951669.308977:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783951669.308981:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfd200, rc 0) 00000100:00100000:3.0:1783951669.309045:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+66:11596:x1870608602328960:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 741us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951669.309061:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:1.0:1783951669.323406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951669.324096:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602329088 00000100:00100000:0.0:1783951669.324107:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602329088 00000100:00100000:0.0:1783951669.324165:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:0.0:1783951669.324175:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+10:2358:x1870608602329088:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951669.324197:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951669.324227:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038993 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951669.324257:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54f135, blocks: 0x1 00010000:00010000:0.0:1783951669.324293:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1783951669.324298:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951669.324309:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.324339:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.324352:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5c00, rc 0) 00000100:00100000:0.0:1783951669.324423:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:2358:x1870608602329088:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 249us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951669.324430:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:1.0:1783951669.330268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.330427:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602329344 00000100:00100000:3.0:1783951669.330436:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602329344 00000100:00100000:3.0:1783951669.330506:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 226 00000100:00100000:3.0:1783951669.330517:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+66:11596:x1870608602329344:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783951669.330629:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+66:11596:x1870608602329344:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 113us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951669.330637:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 226 00000100:00100000:3.0:1783951669.333985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951669.334164:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602329472 00000100:00100000:2.0:1783951669.334173:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602329472 00000100:00100000:2.0:1783951669.334235:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:2.0:1783951669.334254:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:11596:x1870608602329472:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951669.334275:0:8067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951669.334294:0:8067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a03899a expref: -99 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.334326:0:8067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.334336:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951669.334353:0:8067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951669.334360:0:8067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 12 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.334397:0:8067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.334412:0:8067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 12 pid: 6590 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951669.334427:0:8067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8067:1870608624332928:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951669.334530:0:8067:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d60451480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951669.336854:0:8067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8067:1870608624332928:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951669.336887:0:8067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 12 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.336907:0:8067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d4165fa00, rc 0) 00000100:00100000:2.0:1783951669.336958:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+12:11596:x1870608602329472:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 2713us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.336966:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:3.0:1783951669.338779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951669.338887:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602329600 00000100:00100000:0.0:1783951669.338896:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602329600 00010000:00010000:0.0:1783951669.338934:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 12 pid: 6590 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951669.338979:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:0.0:1783951669.338988:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+12:2358:x1870608602329600:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951669.339003:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951669.339029:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 12 pid: 6590 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.339043:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 12 pid: 6590 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.339086:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d81b8d/0x443dabd358eed2be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038993 expref: 12 pid: 6590 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.339103:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951669.339107:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951669.339116:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 11 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.339126:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 11 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.339167:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 11 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951669.339181:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b89c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5777:1870608624333056:192.168.201.6@tcp:105: 00000100:00100000:0.0:1783951669.341796:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71d6a000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951669.351646:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b89c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5777:1870608624333056:192.168.201.6@tcp:105: 00010000:00010000:0.0:1783951669.351673:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951669.351732:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:2358:x1870608602329600:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 12743us (12959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951669.351745:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:1.0:1783951669.354872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.354988:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602329728 00000100:00100000:3.0:1783951669.354997:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602329728 00002000:00100000:3.0:1783951669.355050:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8e8d811a7100 x1870608602329728/t0(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:685/0 lens 504/0 e 0 to 0 dl 1783951680 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951669.355061:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d811a7100 with x1870608602329728 ext(0->12) 00002000:00010000:3.0:1783951669.355067:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d811a7100 00000100:00100000:3.0:1783951669.355102:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1783951669.355112:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+11:2358:x1870608602329728:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783951669.355615:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:2358:x1870608602329728:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 503us (750us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1783951669.355624:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00002000:00100000:3.0:1783951669.355631:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8e8d811a7100 x1870608602329728/t4294967321(0) o4->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:685/0 lens 504/448 e 0 to 0 dl 1783951680 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783951669.355640:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d811a7100 with x1870608602329728 ext(0->12) 00002000:00010000:3.0:1783951669.355649:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d811a7100 00000100:00100000:2.0:1783951669.360048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951669.360121:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602329856 00000100:00100000:1.0:1783951669.360129:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602329856 00000100:00100000:1.0:1783951669.360181:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:1.0:1783951669.360202:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+66:11596:x1870608602329856:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1783951669.443687:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+66:11596:x1870608602329856:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 83475us (83637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951669.443702:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 227 00000001:00080000:0.0:1783951669.444604:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1783951669.444613:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1783951669.444674:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1783951669.444708:0:5813:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8d605d0cc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1783951669.444713:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d44b72000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d605d0540 00000020:00080000:0.0:1783951669.444716:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d44bd3f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d75553400 00000004:00080000:0.0:1783951669.444760:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1783951669.444773:0:5813:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8d65c48b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1783951669.444776:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d8120b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d65c48780 00000020:00080000:0.0:1783951669.444778:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d8120b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d79cf8400 00000001:00080000:0.0:1783951669.444838:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1783951669.444851:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1783951669.444886:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1783951669.445091:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1783951669.445505:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624333184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783951669.445563:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951669.445735:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624333184 00000100:00100000:2.0:1783951669.445743:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624333184 00000100:00100000:2.0:1783951669.445798:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783951669.445832:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624333184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783951669.445862:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1783951669.445901:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a54f133, atime: 0x6a54f133, ctime: 0x6a54f133, blocks: 0xb 00010000:00010000:2.0:1783951669.445909:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.445927:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1783951669.445931:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951669.445938:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.445953:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.445964:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.445971:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.445990:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783951669.446513:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624333184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 706us (948us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783951669.446522:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1783951669.446875:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d811d1880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783951669.446881:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624333184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783951669.447011:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.447204:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602329984 00000100:00100000:3.0:1783951669.447219:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602329984 00000100:00100000:3.0:1783951669.447254:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:3.0:1783951669.447262:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+13:2359:x1870608602329984:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1783951669.447675:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951669.447683:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.447694:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951669.447707:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.447717:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.447737:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.447744:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023b2c47d/0x443dabd358eed2cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.447763:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951669.447765:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951669.447767:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951669.447850:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951669.447864:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624333440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783951669.447908:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951669.447949:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951669.447957:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624333312:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783951669.447980:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951669.448002:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624333440 00000100:00100000:3.0:1783951669.448006:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624333440 00000100:00100000:3.0:1783951669.448037:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624333312 00000100:00100000:3.0:1783951669.448040:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624333312 00000100:00100000:3.0:1783951669.448052:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783951669.448058:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1870608624333440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783951669.448180:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783951669.448184:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783951669 00002000:00010000:3.0:1783951669.448186:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783951669.448189:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783951669 -> 1783951669 00002000:00010000:3.0:1783951669.448197:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783951669.448243:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1870608624333440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (334us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1783951669.448250:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783951669.448265:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783951669.448271:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1870608624333312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783951669.448283:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1783951669.448298:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.448315:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 13 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.448323:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1783951669.448338:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951669.448343:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.448367:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 13 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.448379:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 13 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.448391:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6589:1870608624333568:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951669.448443:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0540 going to sleep for 11 seconds 00000100:00080000:3.0:1783951669.448460:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783951669.448908:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d811a4700/2, rc 0, transno 4294967322 00000100:00100000:3.0:1783951669.448915:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624333440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783951669.451712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951669.451750:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602330112 00000100:00100000:2.0:1783951669.451758:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602330112 00010000:00010000:2.0:1783951669.451793:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 14 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951669.451892:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:2.0:1783951669.451902:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:2359:x1870608602330112:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951669.451917:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951669.451923:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 14 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.451936:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 14 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.451960:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951669.451965:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951669.451972:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.451984:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.452005:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951669.452049:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+14:2359:x1870608602330112:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 147us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.452056:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00010000:00010000:3.0:1783951669.452405:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d57b69/0x443dabd358eed08e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388f9 expref: 13 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.452422:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6589:1870608624333568:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951669.452441:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.452451:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.452457:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.452566:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.452576:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.452600:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951669.453160:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3312:x1870608624333312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4887us (5176us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1783951669.453168:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:3.0:1783951669.454321:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d811a6300/2, rc 0, transno 4294967323 00000100:00100000:3.0:1783951669.454391:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624333312:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783951669.454511:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951669.454519:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.454547:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951669.454551:0:8310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.454562:0:8310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.454582:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.454589:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed2d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.454611:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951669.454613:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951669.454615:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951669.493972:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783951669.498794:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1783951669.498846:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1783951669.498859:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1783951669.498864:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1783951669.499174:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2359:x1870608602329984:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 51906us (52158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951669.499186:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:2.0:1783951669.506692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.506785:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602330368 00000100:00100000:3.0:1783951669.506795:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602330368 00000100:00100000:3.0:1783951669.506891:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 228 00000100:00100000:3.0:1783951669.506902:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11596:x1870608602330368:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951669.506964:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951669.506992:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03898c expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.507015:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:3.0:1783951669.507020:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951669.507057:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.507073:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.507083:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951669.507338:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001af40b8b reply state 00000000b38c1af5 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.507347:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951669.507453:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:11596:x1870608602330368:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 552us (768us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1783951669.507482:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 228 00010000:00010000:3.0:1783951669.509535:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.509549:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.509556:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.509562:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfce00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951669.509567:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.509575:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.509591:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:3.0:1783951669.509593:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951669.509598:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.509604:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951669.513862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.513989:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602330496 00000100:00100000:3.0:1783951669.514000:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602330496 00000100:00100000:3.0:1783951669.514068:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:3.0:1783951669.514079:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602330496:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783951669.514391:0:8067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783951669.514410:0:8067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1783951669 -> 1783951668 00002000:00010000:3.0:1783951669.514412:0:8067:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783951667 00002000:00010000:3.0:1783951669.514414:0:8067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783951669 -> 1783951668 00002000:00010000:3.0:1783951669.514417:0:8067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783951669.514486:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602330496:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 408us (632us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1783951669.514494:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:2.0:1783951669.519002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.519104:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602330752 00000100:00100000:3.0:1783951669.519113:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602330752 00000100:00100000:3.0:1783951669.519177:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:3.0:1783951669.519188:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:11596:x1870608602330752:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783951669.519483:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.519503:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.519513:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.519560:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.519573:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 20 pid: 5793 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.519587:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624333696:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951669.519714:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d65c48900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951669.521986:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624333696:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951669.522021:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951669.523184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951669.523681:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602330880 00000100:00100000:1.0:1783951669.523691:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602330880 00010000:00010000:1.0:1783951669.523738:0:8312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 21 pid: 5793 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951669.523873:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:1.0:1783951669.523884:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:2359:x1870608602330880:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951669.523898:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951669.523906:0:8312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 21 pid: 5793 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.523919:0:8312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 21 pid: 5793 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.523960:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165ec00/0x443dabd358eed29b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03897e expref: 21 pid: 5793 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.523977:0:8312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:1.0:1783951669.523983:0:8312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.523992:0:8312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.523999:0:8312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951669.524031:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951669.524083:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:2359:x1870608602330880:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 201us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951669.524091:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00010000:00010000:3.0:1783951669.524605:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.524615:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.524648:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.524656:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.524662:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.524669:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfce00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951669.524674:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.524681:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.524690:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:3.0:1783951669.524693:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783951669.524697:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.524703:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.524769:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:11596:x1870608602330752:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 5582us (5777us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783951669.524777:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:2.0:1783951669.530443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.530519:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602331008 00000100:00100000:3.0:1783951669.530527:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602331008 00000100:00100000:3.0:1783951669.530575:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:3.0:1783951669.530582:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2358:x1870608602331008:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783951669.530620:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.530637:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 8 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.530643:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951669.530646:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951669.530650:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.530685:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 8 pid: 8067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.530699:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 8 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.530714:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6589:1870608624333824:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951669.530858:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d65c48900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951669.533381:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6589:1870608624333824:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951669.533410:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951669.534261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951669.534560:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602331136 00000100:00100000:0.0:1783951669.534567:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602331136 00010000:00010000:0.0:1783951669.534605:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 9 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951669.534645:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:0.0:1783951669.534653:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+9:2359:x1870608602331136:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951669.534667:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951669.534690:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 9 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.534702:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 9 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.534725:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000828f8f5f/0x443dabd358eed2c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a03899a expref: 9 pid: 8067 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.534754:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951669.534759:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951669.534764:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.534775:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.534807:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951669.534922:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602331136:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 268us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951669.534930:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00010000:00010000:3.0:1783951669.534992:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.535001:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.535027:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.535036:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.535043:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.535050:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfce00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951669.535054:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.535063:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.535091:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.535097:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed2e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.535143:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2358:x1870608602331008:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 4560us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951669.535151:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:2.0:1783951669.544019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.544159:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602331392 00000100:00100000:3.0:1783951669.544168:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602331392 00000100:00100000:3.0:1783951669.544237:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 230 00000100:00100000:3.0:1783951669.544247:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c420cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:11596:x1870608602331392:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783951669.544319:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.544348:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.544359:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.544584:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.544595:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.544614:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.544647:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.544660:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 20 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.544676:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624333952:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951669.544757:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d65c48900 going to sleep for 11 seconds 00000100:00100000:1.0:1783951669.548410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951669.548584:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602331520 00000100:00100000:0.0:1783951669.548593:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602331520 00010000:00010000:0.0:1783951669.548634:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 21 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951669.548675:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:0.0:1783951669.548683:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:2359:x1870608602331520:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951669.548699:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951669.548706:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 21 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.548729:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 21 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.548771:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:0.0:1783951669.548777:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.548787:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.548794:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.548862:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951669.548912:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:2359:x1870608602331520:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 228us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951669.548919:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00010000:00010000:3.0:1783951669.550462:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165e600/0x443dabd358eed2a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038985 expref: 20 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.550496:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624333952:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951669.550527:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.550681:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.550690:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951669.550944:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1783951669.551102:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1783951669.551146:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1783951669.551399:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8c420caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5791:1870608624334080:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783951669.551458:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951669.551601:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d65a2a000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951669.551737:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624334080 00000100:00100000:0.0:1783951669.551743:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624334080 00000100:00100000:0.0:1783951669.551795:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783951669.551805:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1870608624334080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783951669.551965:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1870608624334080:12345-0@lo:1000:mdt00_000.0 Request processed in 162us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951669.551972:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951669.552606:0:5791:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1783951669.552613:0:5791:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:1.0:1783951669.552628:0:5791:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d811a4700, transno 4294967322 00000004:00080000:1.0:1783951669.552677:0:5791:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d811a6300, transno 4294967323 00000100:00100000:1.0:1783951669.553276:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8c420caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5791:1870608624334080:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783951669.554510:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1783951669.554682:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d60b89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5791:1870608624334208:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783951669.554796:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951669.554967:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951669.555006:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624334208 00000100:00100000:2.0:1783951669.555012:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624334208 00000100:00100000:2.0:1783951669.555083:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951669.555093:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1870608624334208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783951669.555421:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5791:x1870608624334208:12345-0@lo:1000:mdt00_000.0 Request processed in 329us (624us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783951669.555429:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951669.555603:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d60b89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5791:1870608624334208:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1783951669.555638:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.555655:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.555662:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.555668:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfd200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951669.555672:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.555679:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.555694:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d44e70800) 00010000:00010000:0.0:1783951669.555698:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951669.555703:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.555968:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd200/0x443dabd358eed2f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556001:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556008:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556013:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556018:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165f000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951669.556027:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556033:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556043:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:0.0:1783951669.556045:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951669.556052:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038969 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556064:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038969 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556073:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038969 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.556102:0:5791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038969 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951669.556115:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65ac7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624334336:192.168.201.6@tcp:105: 00000100:00100000:0.0:1783951669.556275:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e1240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951669.560527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951669.560590:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602331648 00000100:00100000:2.0:1783951669.560599:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602331648 00000100:00100000:2.0:1783951669.560645:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:2.0:1783951669.560653:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:11595:x1870608602331648:12345-192.168.201.6@tcp:49:lfs.0 00000100:00100000:0.0:1783951669.560922:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65ac7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1870608624334336:192.168.201.6@tcp:105: 00010000:00010000:0.0:1783951669.560948:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.560958:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165f000/0x443dabd358eed239 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.560987:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561010:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561021:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561031:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561036:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561043:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561049:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5a00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951669.561052:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561059:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561069:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:0.0:1783951669.561072:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951669.561075:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561080:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5a00/0x443dabd358eed2fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561089:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561097:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561103:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561108:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfce00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951669.561111:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561117:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561123:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:0.0:1783951669.561125:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951669.561128:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.561133:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed2ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951669.561413:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951669.561418:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951669.562013:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1783951669.562021:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951669.563057:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:11595:x1870608602331648:12345-192.168.201.6@tcp:49:lfs.0 Request processed in 2395us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.563069:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:0.0:1783951669.563122:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c420cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:11596:x1870608602331392:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 18875us (19111us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1783951669.563131:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 230 00000020:00080000:0.0:1783951669.563136:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783951669.566279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.566980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951669.567057:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602332160 00000100:00100000:1.0:1783951669.567066:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602332160 00000100:00100000:1.0:1783951669.567122:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 231 00000100:00100000:1.0:1783951669.567130:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+23:11595:x1870608602332160:12345-192.168.201.6@tcp:58:lfs.0 00000040:00080000:1.0:1783951669.568018:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1783951669.568171:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602331904 00000100:00100000:0.0:1783951669.568184:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602331904 00000100:00100000:0.0:1783951669.568231:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1783951669.568240:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d601d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+24:11596:x1870608602331904:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783951669.568652:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:11595:x1870608602332160:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 1520us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951669.568661:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 231 00000004:00080000:0.0:1783951669.569409:0:5794:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783951669.569704:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1783951669.569907:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.569926:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.569937:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.569948:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.569956:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.569963:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951669.570026:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783951669.570114:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d601d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:11596:x1870608602331904:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1873us (3839us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1783951669.570123:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000020:00080000:0.0:1783951669.570128:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783951669.587378:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951669.587407:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.587420:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951669.587423:0:8311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.587431:0:8311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.587450:0:8311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8d452ae000) 00010000:00010000:2.0:1783951669.587452:0:8311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783951669.587455:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.587458:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce4400/0x443dabd358eed304 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.587487:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951669.587489:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951669.587490:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951669.589576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951669.589618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951669.589651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951669.589688:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602332416 00000100:00100000:1.0:1783951669.589699:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602332416 00000100:00100000:1.0:1783951669.589774:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:1.0:1783951669.589784:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602332416:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951669.589906:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602332416:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951669.589915:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00080000:1.0:1783951669.589936:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951669.590246:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602332288 00000100:00100000:3.0:1783951669.590251:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602332288 00000100:00100000:3.0:1783951669.590285:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 293 00000100:00100000:3.0:1783951669.590292:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602332288:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951669.590328:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602332288:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951669.590349:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 293 00000100:00100000:2.0:1783951669.591388:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602332544 00000100:00100000:2.0:1783951669.591398:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602332544 00000100:00100000:2.0:1783951669.591458:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:2.0:1783951669.591477:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602332544:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951669.591532:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5168f61-b22b-4094-aa34-e52db03426e1+5:2360:x1870608602332544:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 66us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.591539:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00080000:3.0:1783951669.591655:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951669.614527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.614631:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602332672 00000100:00100000:3.0:1783951669.614641:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602332672 00000100:00100000:3.0:1783951669.614793:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 232 00000100:00100000:3.0:1783951669.614805:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+25:11598:x1870608602332672:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951669.614870:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951669.614891:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd800/0x443dabd358eed30b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0389a1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.614954:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.614970:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.614982:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.614998:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.615005:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.615011:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.615361:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.615399:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 26 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.615407:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.615443:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 26 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.615457:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 26 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951669.615471:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624334464:192.168.201.6@tcp:104: 00000100:00100000:3.0:1783951669.615557:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d65c48240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951669.621403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951669.621505:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1870608624334464:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951669.621534:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951669.621925:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602332928 00000100:00100000:0.0:1783951669.621932:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602332928 00000100:00100000:1.0:1783951669.622089:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:1.0:1783951669.622100:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:5573:x1870608602332928:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783951669.622334:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:5573:x1870608602332928:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 235us (956us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1783951669.622349:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:0.0:1783951669.624212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951669.624308:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602333056 00000100:00100000:2.0:1783951669.624316:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602333056 00010000:00010000:2.0:1783951669.624361:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 28 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951669.624406:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:2.0:1783951669.624415:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:2358:x1870608602333056:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951669.624437:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951669.624444:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 28 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.624454:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 28 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.624476:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed22b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038962 expref: 28 pid: 5792 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.624492:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951669.624496:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.624505:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.624513:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951669.624551:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951669.624605:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:2358:x1870608602333056:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 191us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951669.624612:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00010000:00010000:3.0:1783951669.624674:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624682:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951669.624726:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783951669.624730:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951669.624747:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624769:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624778:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624785:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624792:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624797:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951669.624801:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624852:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624863:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951669.624866:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951669.624870:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624876:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfc400/0x443dabd358eed312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624886:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624893:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624904:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624909:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfdc00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951669.624913:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624920:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624927:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8d821cf700) 00010000:00010000:3.0:1783951669.624929:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951669.624932:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624938:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfdc00/0x443dabd358eed319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624970:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd800/0x443dabd358eed30b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389a1 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624983:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389a1 expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951669.624990:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:3.0:1783951669.624992:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951669.624995:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfd600, rc 0) 00000100:00100000:3.0:1783951669.625020:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:11598:x1870608602332672:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 10219us (10502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951669.625037:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 232 00000040:00080000:2.0:1783951670.512100:0:12435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951670.512116:0:12435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951670.512176:0:12435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783951670.512184:0:12435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783951670.518515:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951670.582426:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951670.582436:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951670.582477:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783951670.582484:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951670.582618:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624334592:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783951670.582707:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d526e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951670.587264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951670.587373:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602333184 00000100:00100000:1.0:1783951670.587383:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602333184 00000100:00100000:1.0:1783951670.587529:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 233 00000100:00100000:1.0:1783951670.587542:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:11610:x1870608602333184:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1783951670.587701:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951670.587773:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11551:1870608624334592:192.168.201.6@tcp:107:hsm_cdtr.0 00000004:00000080:1.0:1783951670.588027:0:8068:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783951670.588146:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:11610:x1870608602333184:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 607us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951670.588154:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 233 00000100:00100000:1.0:1783951670.600663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951670.600926:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602333440 00000100:00100000:2.0:1783951670.600938:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602333440 00000100:00100000:2.0:1783951670.601010:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 234 00000100:00100000:2.0:1783951670.601023:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+26:11610:x1870608602333440:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951670.601054:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951670.601081:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324c00/0x443dabd358eed327 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0389a8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951670.601195:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325a00/0x443dabd358eed32e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951670.601211:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325a00/0x443dabd358eed32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951670.601226:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325a00/0x443dabd358eed32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951670.601239:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783951670.601524:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324c00/0x443dabd358eed327 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389a8 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951670.601545:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325a00/0x443dabd358eed32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389a8 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951670.601567:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:2.0:1783951670.601625:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951670.601629:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325a00, rc 0) 00000100:00100000:2.0:1783951670.601695:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:11610:x1870608602333440:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 674us (1043us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1783951670.601704:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 234 00000100:00100000:2.0:1783951670.605251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951670.605454:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602333568 00000100:00100000:1.0:1783951670.605465:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602333568 00000100:00100000:1.0:1783951670.605552:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1783951670.605562:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:2358:x1870608602333568:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951670.605683:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951670.605710:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325a00/0x443dabd358eed32e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389a8 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.605728:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:1.0:1783951670.605733:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951670.605797:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:2358:x1870608602333568:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 237us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951670.605834:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1783951670.607206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951670.607620:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602333824 00000100:00100000:1.0:1783951670.607628:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602333824 00000100:00100000:1.0:1783951670.607680:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 235 00000100:00100000:1.0:1783951670.607690:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+27:11610:x1870608602333824:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783951670.607781:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.607799:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.607843:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.608099:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.608107:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.608114:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.608120:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951670.608125:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.608132:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.608144:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:1.0:1783951670.608147:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951670.608151:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951670.608158:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed33c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951670.608339:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:11610:x1870608602333824:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 648us (1136us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1783951670.608356:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 235 00000040:00080000:0.0:1783951670.608393:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951670.608399:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951670.608978:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783951670.608987:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951670.610980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951670.611178:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602334080 00000100:00100000:1.0:1783951670.611189:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602334080 00000100:00100000:1.0:1783951670.611258:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:1.0:1783951670.611270:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+28:11610:x1870608602334080:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783951670.611693:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:11610:x1870608602334080:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 425us (722us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1783951670.611702:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00010000:00010000:2.0:1783951671.542007:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951671.670351:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951671.670363:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951671.670398:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783951671.670404:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783951672.292566:0:12487:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951672.292576:0:12487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951672.292628:0:12487:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783951672.292633:0:12487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951672.475987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951672.479112:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602334336 00000100:00100000:0.0:1783951672.479128:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602334336 00000100:00100000:0.0:1783951672.479235:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:0.0:1783951672.479249:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+29:11631:x1870608602334336:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951672.479276:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951672.479298:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eed343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0389af expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951672.479403:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eed34a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951672.479417:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eed34a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951672.479443:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eed34a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951672.479457:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783951672.479608:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5400/0x443dabd358eed343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389af expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951672.479624:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eed34a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389af expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951672.479632:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:0.0:1783951672.479636:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783951672.479639:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5800, rc 0) 00000100:00100000:0.0:1783951672.479717:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:11631:x1870608602334336:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 472us (3736us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1783951672.479725:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00080000:3.0:1783951672.480009:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951672.483168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951672.483438:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602334464 00000100:00100000:1.0:1783951672.483449:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602334464 00000100:00100000:1.0:1783951672.483517:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 237 00000100:00100000:1.0:1783951672.483527:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:11631:x1870608602334464:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1783951672.483589:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483606:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483617:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483646:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483652:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483659:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483666:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951672.483681:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483688:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483700:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:1.0:1783951672.483703:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951672.483706:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.483712:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951672.483791:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:11631:x1870608602334464:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 265us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951672.483799:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 237 00010000:00010000:3.0:1783951672.567646:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951672.633667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951672.633782:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602334592 00000100:00100000:1.0:1783951672.633799:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602334592 00000100:00100000:1.0:1783951672.633931:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:1.0:1783951672.633945:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2361:x1870608602334592:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:1.0:1783951672.633965:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951672.633986:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071259516/0x443dabd358eed35f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0389b6 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951672.634016:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a54f134, atime: 0x6a54f133, ctime: 0x6a54f134, blocks: 0xb 00000100:00080000:3.0:1783951672.634027:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951672.634042:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1783951672.634048:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951672.634058:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071259516/0x443dabd358eed35f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389b6 expref: 8 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.634094:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000071259516/0x443dabd358eed35f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389b6 expref: 8 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951672.634107:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29c00, rc 0) 00000100:00100000:1.0:1783951672.634219:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2361:x1870608602334592:12345-192.168.201.6@tcp:101:cat.0 Request processed in 278us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951672.634227:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:3.0:1783951672.641523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951672.641588:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602334720 00000100:00100000:1.0:1783951672.641600:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602334720 00002000:00100000:1.0:1783951672.641649:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8e8d7f619c00 x1870608602334720/t0(0) o3->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:688/0 lens 488/0 e 0 to 0 dl 1783951683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951672.641658:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d7f619c00 with x1870608602334720 ext(0->4095) 00002000:00010000:1.0:1783951672.641662:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d7f619c00 00000100:00100000:1.0:1783951672.641690:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1783951672.641699:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602334720:12345-192.168.201.6@tcp:3:cat.0 00000100:00100000:1.0:1783951672.641962:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2359:x1870608602334720:12345-192.168.201.6@tcp:3:cat.0 Request processed in 262us (447us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783951672.641971:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00002000:00100000:1.0:1783951672.641983:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8e8d7f619c00 x1870608602334720/t0(0) o3->65c652b5-a392-4c36-a8f6-f2bd53c90279@192.168.201.6@tcp:688/0 lens 488/4536 e 0 to 0 dl 1783951683 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951672.641991:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8d7f619c00 with x1870608602334720 ext(0->4095) 00002000:00010000:1.0:1783951672.641994:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8d7f619c00 00000100:00100000:3.0:1783951672.694919:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624334720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951672.695020:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951672.695603:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624334720 00000100:00100000:1.0:1783951672.695627:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624334720 00000100:00080000:3.0:1783951672.695685:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951672.696158:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783951672.696169:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624334720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951672.696240:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951672.698869:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624334720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2692us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951672.698882:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783951672.698946:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624334720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783951673.591400:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951673.718269:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624334848:0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.718375:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951673.718444:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624335360:0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.718476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951673.718516:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783951673.718522:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624334976:0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.718548:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951673.718566:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624335488:0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.718598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951673.718687:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624335360 00000100:00100000:0.0:1783951673.718696:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624335360 00000100:00100000:0.0:1783951673.718778:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624334976 00000100:00100000:0.0:1783951673.718781:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624334976 00000100:00100000:0.0:1783951673.718806:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783951673.718841:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624335360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.718907:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624335360:12345-0@lo:400:kworker.0 Request processed in 68us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951673.718915:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783951673.718938:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783951673.718945:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624334976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.718972:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624334976:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951673.718978:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783951673.718998:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624335488 00000100:00100000:0.0:1783951673.719002:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624335488 00000100:00100000:0.0:1783951673.719032:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783951673.719039:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.719068:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1870608624335488:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951673.719075:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783951673.719125:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624334976:0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.719139:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624335488:0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.719150:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624335360:0@lo:400:kworker.0 00000100:00100000:1.0:1783951673.719271:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624334848 00000100:00100000:1.0:1783951673.719276:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624334848 00000100:00100000:1.0:1783951673.719311:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783951673.719318:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624334848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951673.719364:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624334848:12345-0@lo:400:kworker.0 Request processed in 47us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951673.719371:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783951673.719410:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624334848:0@lo:400:kworker.0 00000100:00100000:3.0:1783951673.719584:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624335232:0@lo:400:kworker.0 00000100:00100000:3.0:1783951673.719625:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951673.719661:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951673.719669:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624335104:0@lo:400:kworker.0 00000100:00100000:3.0:1783951673.719693:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783951673.719720:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951673.719726:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951673.719735:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624335104 00000100:00100000:3.0:1783951673.719739:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624335104 00000100:00100000:3.0:1783951673.719782:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783951673.719789:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624335104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951673.719858:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870608624335104:12345-0@lo:400:kworker.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951673.719881:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1783951673.719898:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951673.719918:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1870608624335104:0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.721534:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624335232 00000100:00100000:0.0:1783951673.721549:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624335232 00000100:00100000:0.0:1783951673.721637:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783951673.721648:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624335232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951673.721744:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1870608624335232:12345-0@lo:400:kworker.0 Request processed in 98us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951673.721765:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783951673.724004:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624335232:0@lo:400:kworker.0 00000001:00080000:0.0:1783951673.824095:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1783951674.233201:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624335616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951674.233325:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951674.233795:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624335616 00000100:00100000:0.0:1783951674.233828:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624335616 00000100:00100000:0.0:1783951674.233927:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951674.233940:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624335616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951674.234010:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951674.234076:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624335616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951674.234084:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951674.234398:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1783951674.234406:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d811d1880, transno 4294967310 00000100:00100000:0.0:1783951674.234440:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624335616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951674.618036:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951674.706525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951674.706570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951674.706615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951674.706653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951674.706690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951674.706749:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602335232 00000100:00100000:2.0:1783951674.706764:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602335232 00000100:00100000:3.0:1783951674.707326:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602334976 00000100:00100000:3.0:1783951674.707333:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602334976 00000100:00100000:3.0:1783951674.707388:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602335360 00000100:00100000:3.0:1783951674.707391:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602335360 00000100:00100000:3.0:1783951674.707420:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:3.0:1783951674.707433:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:2361:x1870608602334976:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951674.707554:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+31:2361:x1870608602334976:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 123us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951674.707563:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:3.0:1783951674.707586:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:3.0:1783951674.707592:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602335360:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951674.707616:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+5:2361:x1870608602335360:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951674.707622:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:1.0:1783951674.707958:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602334848 00000100:00100000:1.0:1783951674.707965:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602334848 00000100:00100000:1.0:1783951674.708145:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 295 00000100:00100000:1.0:1783951674.708153:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602334848:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951674.708197:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602334848:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 45us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951674.708205:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 295 00000100:00080000:1.0:1783951674.708300:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951674.708306:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951674.708412:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602335104 00000100:00100000:0.0:1783951674.708418:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602335104 00000100:00100000:0.0:1783951674.708466:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:0.0:1783951674.708474:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2361:x1870608602335104:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951674.708518:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+8:2361:x1870608602335104:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 45us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951674.708525:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00080000:1.0:1783951674.708717:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951674.709135:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:2.0:1783951674.709148:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602335232:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951674.709208:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602335232:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 64us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951674.709235:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 93 00000001:00080000:3.0:1783951674.817357:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1783951674.817380:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1783951674.836874:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1783951674.837157:0:5813:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8d7f774900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1783951674.837165:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d8120bd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d7f774cc0 00000020:00080000:2.0:1783951674.837170:0:5813:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e8d8120bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8d811a2400 00000020:00080000:2.0:1783951674.837362:0:5813:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1783951674.837977:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1783951674.838370:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1783951675.644996:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951676.669951:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951677.468567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951677.475626:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602335488 00000100:00100000:0.0:1783951677.475647:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602335488 00000100:00100000:0.0:1783951677.477052:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 238 00000100:00100000:0.0:1783951677.477069:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11283:x1870608602335488:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783951677.477377:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11283:x1870608602335488:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 Request processed in 312us (8823us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951677.477387:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 238 00000100:00080000:1.0:1783951677.481475:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951677.482378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951677.484536:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602335744 00000100:00100000:0.0:1783951677.484556:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602335744 00000100:00100000:0.0:1783951677.484650:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:0.0:1783951677.484665:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:11283:x1870608602335744:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783951677.490782:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:11283:x1870608602335744:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 5197us (7491us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1783951677.490805:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:0.0:1783951677.670008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951677.670333:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602335872 00000100:00100000:2.0:1783951677.670349:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602335872 00000100:00100000:2.0:1783951677.670460:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 239 00000100:00100000:2.0:1783951677.670474:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:12083:x1870608602335872:12345-192.168.201.6@tcp:101:lsof.0 00010000:00010000:2.0:1783951677.670505:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951677.670536:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324800/0x443dabd358eed366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a0389bd expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951677.670631:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed36d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951677.670650:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed36d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951677.670668:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed36d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951677.671023:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783951677.671029:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951677.671134:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed36d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951677.671177:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324800/0x443dabd358eed366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389bd expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951677.671198:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed36d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389bd expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951677.671207:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:2.0:1783951677.671210:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951677.671214:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325600, rc 0) 00000100:00100000:2.0:1783951677.671298:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+6:12083:x1870608602335872:12345-192.168.201.6@tcp:101:lsof.0 Request processed in 829us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951677.671306:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 239 00000100:00080000:3.0:1783951677.672380:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783951677.696088:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951677.820593:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624335744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951677.821011:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951677.821271:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624335744 00000100:00100000:0.0:1783951677.821282:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624335744 00000100:00100000:0.0:1783951677.821351:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783951677.821369:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624335744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951677.821404:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951677.821460:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624335744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951677.821468:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951677.821612:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1783951677.821619:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00080000:3.0:1783951677.821720:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951677.821962:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624335744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951678.710557:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951678.838306:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624336000:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.838399:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951678.838463:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624336512:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.838487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951678.838530:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783951678.838536:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624335872:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.838563:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951678.838593:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624336384:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.838614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951678.838646:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624336000 00000100:00100000:0.0:1783951678.838654:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624336000 00000100:00100000:0.0:1783951678.838708:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624336384 00000100:00100000:0.0:1783951678.838711:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624336384 00000100:00100000:0.0:1783951678.838740:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783951678.838748:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624336000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.838795:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624336000:12345-0@lo:400:kworker.0 Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951678.838803:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783951678.838841:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783951678.838847:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624336384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.838870:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624336384:12345-0@lo:400:kworker.0 Request processed in 24us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951678.838875:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783951678.838895:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624336512 00000100:00100000:0.0:1783951678.838898:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624336512 00000100:00100000:0.0:1783951678.838923:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783951678.838928:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624336512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.838954:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624336512:12345-0@lo:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951678.838961:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783951678.838980:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624335872 00000100:00100000:0.0:1783951678.838989:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624335872 00000100:00100000:0.0:1783951678.839013:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1783951678.839018:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624335872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.839042:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d584c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624335872:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951678.839047:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1783951678.839077:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624336128:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.839099:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951678.839113:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951678.839118:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624336256:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.839136:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951678.839154:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624336128 00000100:00100000:0.0:1783951678.839156:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624336128 00000100:00100000:0.0:1783951678.839178:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783951678.839183:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624336128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.839209:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624336128:12345-0@lo:400:kworker.0 Request processed in 25us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951678.839214:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783951678.839252:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624336128:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.839276:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624335872:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.839285:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624336384:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.839294:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624336000:0@lo:400:kworker.0 00000100:00100000:0.0:1783951678.839301:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624336512:0@lo:400:kworker.0 00000100:00080000:3.0:1783951678.840056:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951678.840062:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951678.840201:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624336256 00000100:00100000:2.0:1783951678.840214:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624336256 00000100:00100000:2.0:1783951678.840250:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783951678.840258:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624336256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951678.840320:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624336256:12345-0@lo:400:kworker.0 Request processed in 63us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951678.840326:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783951678.840464:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624336256:0@lo:400:kworker.0 00000100:00100000:2.0:1783951679.351035:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624336640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951679.351116:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951679.351208:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624336640 00000100:00100000:0.0:1783951679.351228:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624336640 00000100:00100000:0.0:1783951679.351277:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783951679.351286:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624336640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951679.351322:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951679.351369:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624336640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951679.351377:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783951679.351414:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624336640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783951679.734707:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951679.825106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951679.825148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951679.825188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951679.825230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951679.825262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951679.825288:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602336512 00000100:00100000:2.0:1783951679.825311:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602336512 00000100:00100000:2.0:1783951679.825391:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602336128 00000100:00100000:2.0:1783951679.825395:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602336128 00000100:00100000:0.0:1783951679.825404:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602336256 00000100:00100000:0.0:1783951679.825409:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602336256 00000100:00100000:2.0:1783951679.825428:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 157 00000100:00100000:2.0:1783951679.825441:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+6:2361:x1870608602336512:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951679.825448:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602336384 00000100:00100000:0.0:1783951679.825452:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602336384 00000100:00100000:0.0:1783951679.825478:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:0.0:1783951679.825487:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2361:x1870608602336256:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951679.825515:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5168f61-b22b-4094-aa34-e52db03426e1+6:2361:x1870608602336512:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951679.825523:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 157 00000100:00100000:0.0:1783951679.825539:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2361:x1870608602336256:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 52us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951679.825544:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 158 00000100:00100000:0.0:1783951679.825553:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:2.0:1783951679.825558:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:2361:x1870608602336128:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951679.825579:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:0.0:1783951679.825588:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602336384:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951679.825594:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:2361:x1870608602336128:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 38us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951679.825602:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 158 00000100:00100000:0.0:1783951679.825634:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2361:x1870608602336384:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 47us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951679.825642:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00080000:1.0:1783951679.825742:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951679.825749:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951679.825752:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951679.825845:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602336000 00000100:00100000:3.0:1783951679.825851:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602336000 00000100:00100000:3.0:1783951679.825883:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 297 00000100:00100000:3.0:1783951679.825890:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602336000:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951679.837960:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602336000:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 12056us (12851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951679.837978:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 297 00000001:00080000:3.0:1783951679.900287:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1783951679.900397:0:5813:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1783951679.900433:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1783951679.900447:0:5824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1783951680.760053:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951681.788751:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951681.913749:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951681.913760:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951681.914259:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783951681.914265:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1783951682.151404:0:12688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:08:00 (1783951680) 00010000:00010000:1.0:1783951682.811877:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951682.935088:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624336768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951682.935171:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951682.937527:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624336768 00000100:00100000:1.0:1783951682.937541:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624336768 00000100:00100000:1.0:1783951682.937632:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783951682.937644:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624336768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951682.937689:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951682.937770:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624336768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951682.937777:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1783951682.937877:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951682.939013:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624336768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783951683.830194:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951683.962177:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624336896:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962259:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951683.962318:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624337408:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962360:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951683.962386:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783951683.962392:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624337024:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951683.962430:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624337536:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962452:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951683.962482:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624337152:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951683.962522:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951683.962528:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624337280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951683.962591:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624336896 00000100:00100000:0.0:1783951683.962599:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624336896 00000100:00100000:0.0:1783951683.962643:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1783951683.962652:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624336896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962700:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624336896:12345-0@lo:400:kworker.0 Request processed in 48us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951683.962708:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1783951683.962746:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624337408 00000100:00100000:0.0:1783951683.962750:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624337408 00000100:00100000:0.0:1783951683.962786:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624337024 00000100:00100000:0.0:1783951683.962789:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624337024 00000100:00100000:0.0:1783951683.962801:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624337152 00000100:00100000:0.0:1783951683.962803:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624337152 00000100:00100000:0.0:1783951683.962848:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783951683.962855:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624337408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962886:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624337408:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951683.962900:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783951683.962913:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783951683.962920:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624337024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962947:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624337024:12345-0@lo:400:kworker.0 Request processed in 29us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951683.962953:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783951683.962964:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783951683.962970:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624337152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.962999:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624337152:12345-0@lo:400:kworker.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951683.963004:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783951683.963026:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624337536 00000100:00100000:0.0:1783951683.963029:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624337536 00000100:00100000:0.0:1783951683.963056:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624337280 00000100:00100000:0.0:1783951683.963059:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624337280 00000100:00100000:0.0:1783951683.963081:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783951683.963087:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624337536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.963117:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624337536:12345-0@lo:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951683.963123:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783951683.963135:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783951683.963141:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624337280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.963168:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624337280:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951683.963175:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1783951683.963209:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951683.963214:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951683.963265:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624337280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.963276:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624337152:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.963307:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624337024:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.963318:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624337536:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.963326:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624336896:0@lo:400:kworker.0 00000100:00100000:0.0:1783951683.963336:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624337408:0@lo:400:kworker.0 00000100:00100000:1.0:1783951684.473458:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951684.475239:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624337664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951684.475334:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951684.476667:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624337664 00000100:00100000:2.0:1783951684.476678:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624337664 00000100:00100000:2.0:1783951684.476895:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783951684.476906:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624337664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951684.476957:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951684.477262:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624337664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 356us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951684.477283:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951684.477656:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624337664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783951684.854096:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951684.948998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951684.949055:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951684.949097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951684.949128:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951684.949150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951684.949286:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602336896 00000100:00100000:0.0:1783951684.949296:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602336896 00000100:00100000:0.0:1783951684.949361:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602337024 00000100:00100000:0.0:1783951684.949365:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602337024 00000100:00100000:0.0:1783951684.949389:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:0.0:1783951684.949401:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2360:x1870608602336896:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951684.949477:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2360:x1870608602336896:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 77us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951684.949484:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:0.0:1783951684.949515:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:0.0:1783951684.949522:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602337024:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951684.949547:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2360:x1870608602337024:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951684.949553:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:0.0:1783951684.949597:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602337152 00000100:00100000:0.0:1783951684.949600:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602337152 00000100:00100000:0.0:1783951684.949626:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602336768 00000100:00100000:0.0:1783951684.949629:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602336768 00000100:00100000:0.0:1783951684.949648:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:0.0:1783951684.949656:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+6:2360:x1870608602337152:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951684.949684:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5168f61-b22b-4094-aa34-e52db03426e1+6:2360:x1870608602337152:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951684.949689:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:0.0:1783951684.949700:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:0.0:1783951684.949704:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:2360:x1870608602336768:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951684.949724:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:2360:x1870608602336768:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 19us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951684.949729:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:2.0:1783951684.950152:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602336640 00000100:00100000:2.0:1783951684.950156:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602336640 00000100:00100000:2.0:1783951684.950194:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 299 00000100:00100000:2.0:1783951684.950201:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602336640:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951684.950232:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2360:x1870608602336640:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 33us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951684.950238:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 299 00000100:00080000:1.0:1783951684.950401:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951684.950406:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951684.950409:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951685.882644:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951686.491542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951686.491633:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602337408 00000100:00100000:0.0:1783951686.491644:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602337408 00000100:00100000:0.0:1783951686.491725:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:0.0:1783951686.491736:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+18:12304:x1870608602337408:12345-192.168.201.6@tcp:35:umount.0 00000100:00080000:1.0:1783951686.492354:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951686.494501:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:12304:x1870608602337408:12345-192.168.201.6@tcp:35:umount.0 Request processed in 2755us (2965us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1783951686.494517:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:0.0:1783951686.503866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951686.504219:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602337664 00000100:00100000:3.0:1783951686.504242:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602337664 00000100:00100000:3.0:1783951686.504308:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:3.0:1783951686.504319:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+19:12304:x1870608602337664:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:3.0:1783951686.505064:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:12304:x1870608602337664:12345-192.168.201.6@tcp:35:umount.0 Request processed in 742us (1203us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1783951686.505073:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:2.0:1783951686.520404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951686.520491:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602337920 00000100:00100000:3.0:1783951686.520501:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602337920 00000100:00100000:3.0:1783951686.520597:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:3.0:1783951686.520608:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d601d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+20:12304:x1870608602337920:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:2.0:1783951686.521886:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d601d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:12304:x1870608602337920:12345-192.168.201.6@tcp:35:umount.0 Request processed in 1274us (1488us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1783951686.521896:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:1.0:1783951686.553318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951686.553459:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602338176 00000100:00100000:0.0:1783951686.553470:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602338176 00000100:00100000:0.0:1783951686.553546:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:0.0:1783951686.553558:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d74fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:12304:x1870608602338176:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:0.0:1783951686.554006:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d74fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:12304:x1870608602338176:12345-192.168.201.6@tcp:35:umount.0 Request processed in 448us (695us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1783951686.554014:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:1.0:1783951686.561901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951686.561942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951686.562063:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602338304 00000100:00100000:3.0:1783951686.562072:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602338304 00000100:00100000:3.0:1783951686.562130:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602338432 00000100:00100000:3.0:1783951686.562133:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602338432 00000100:00100000:3.0:1783951686.562163:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1783951686.562173:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86850dbf-e7ae-4b99-b87c-55f16448ce1f+14:2361:x1870608602338304:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951686.562188:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951686.562208:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff9200/0x443dabd358eec3e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038548 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.562238:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951686.562291:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86850dbf-e7ae-4b99-b87c-55f16448ce1f+13:2361:x1870608602338304:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 120us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951686.562299:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1783951686.562317:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1783951686.562323:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86850dbf-e7ae-4b99-b87c-55f16448ce1f+12:2361:x1870608602338432:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951686.562331:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951686.562340:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165f600/0x443dabd358eec34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038510 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.562350:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951686.562367:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:2361:x1870608602338432:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 44us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951686.562374:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1783951686.570029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951686.570150:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602338560 00000100:00100000:1.0:1783951686.570158:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602338560 00000100:00100000:1.0:1783951686.570223:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783951686.570243:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86850dbf-e7ae-4b99-b87c-55f16448ce1f+11:2360:x1870608602338560:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951686.570259:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951686.570279:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d40031000/0x443dabd358eec5f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038613 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951686.570300:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951686.570359:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602338560:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 119us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951686.570367:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1783951686.574419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951686.574515:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602338688 00000100:00100000:0.0:1783951686.574525:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602338688 00000100:00100000:0.0:1783951686.574623:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:0.0:1783951686.574635:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2357:x1870608602338688:12345-192.168.201.6@tcp:9:umount.0 00000020:00000080:0.0:1783951686.574677:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec6bd 00000100:00080000:0.0:1783951686.574688:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8e8d448cf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951686.574742:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1783951686.575290:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951686.575365:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65c652b5-a392-4c36-a8f6-f2bd53c90279+2:2357:x1870608602338688:12345-192.168.201.6@tcp:9:umount.0 Request processed in 730us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951686.575375:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00010000:00010000:3.0:1783951686.575468:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951686.591940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951686.592421:0:8067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602339072 00000100:00100000:2.0:1783951686.592431:0:8067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602339072 00000100:00100000:2.0:1783951686.592522:0:8067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:2.0:1783951686.592544:0:8067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+7:2357:x1870608602339072:12345-192.168.201.6@tcp:9:umount.0 00000020:00000080:2.0:1783951686.592593:0:8067:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec925 00000020:00010000:2.0:1783951686.592601:0:8067:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8d452ec000: total 0 00000100:00080000:2.0:1783951686.592607:0:8067:0:(import.c:65:import_set_state_nolock()) ffff8e8d452eb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951686.592676:0:8067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1783951686.593336:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951686.593456:0:8067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65c652b5-a392-4c36-a8f6-f2bd53c90279+5:2357:x1870608602339072:12345-192.168.201.6@tcp:9:umount.0 Request processed in 921us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951686.593465:0:8067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000020:00010000:3.0:1783951686.593539:0:8310:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8d452ec000: total 0 00010000:00010000:3.0:1783951686.593589:0:8310:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8d452ec000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783951686.593646:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071259516/0x443dabd358eed35f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389b6 expref: 4 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.593697:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019581eb0/0x443dabd358eeccc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387e8 expref: 3 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.593723:0:8310:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8d452ec000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783951686.593735:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951686.593737:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951686.593739:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951686.617893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951686.618021:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602340096 00000100:00100000:0.0:1783951686.618043:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602340096 00000100:00100000:0.0:1783951686.618133:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 240 00000100:00100000:0.0:1783951686.618144:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+22:2357:x1870608602340096:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:0.0:1783951686.618195:0:5791:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec359 00000020:00010000:0.0:1783951686.618216:0:5791:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8d79d97000: total 0 00000100:00080000:0.0:1783951686.618222:0:5791:0:(import.c:65:import_set_state_nolock()) ffff8e8d79d92000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951686.618271:0:5791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1783951686.618755:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65c652b5-a392-4c36-a8f6-f2bd53c90279+21:2357:x1870608602340096:12345-192.168.201.6@tcp:39:umount.0 Request processed in 612us (875us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1783951686.618764:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 240 00000020:00010000:3.0:1783951686.618971:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8d79d97000: total 0 00010000:00010000:3.0:1783951686.619015:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8d79d97000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783951686.619054:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951686.619057:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951686.619066:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8800/0x443dabd358eed01e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0388dd expref: 20 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619085:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:3.0:1783951686.619087:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951686.619091:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5e400/0x443dabd358eec980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03870f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619102:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8d821cf800) 00010000:00010000:3.0:1783951686.619104:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951686.619107:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9600/0x443dabd358eec623 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038621 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619125:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:3.0:1783951686.619135:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951686.619140:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28c00/0x443dabd358eecba2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03879b expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619154:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8d821cf100) 00010000:00010000:3.0:1783951686.619158:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783951686.619161:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff9c00/0x443dabd358eec693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03863d expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619174:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:3.0:1783951686.619177:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951686.619179:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28800/0x443dabd358eed240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038969 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619190:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8d71d6d500) 00010000:00010000:3.0:1783951686.619192:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783951686.619195:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29400/0x443dabd358eecd3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03880b expref: 14 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619210:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:3.0:1783951686.619212:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951686.619217:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d74ff8000/0x443dabd358eecd23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038804 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619242:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d71d6dc00) 00010000:00010000:3.0:1783951686.619244:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951686.619247:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d60d5f800/0x443dabd358eec63f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038628 expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619277:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:3.0:1783951686.619280:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951686.619284:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfd600/0x443dabd358eed320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389a1 expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619295:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8d44e70d00) 00010000:00010000:3.0:1783951686.619298:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783951686.619302:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d65ce5800/0x443dabd358eed34a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389af expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619316:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:3.0:1783951686.619319:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951686.619322:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28a00/0x443dabd358eecc82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387d3 expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619334:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8d44e70b00) 00010000:00010000:3.0:1783951686.619336:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783951686.619340:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d4165fe00/0x443dabd358eeccac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0387e1 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951686.619352:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8d79d97000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1783951686.619364:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951686.619366:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951686.619368:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951686.902736:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951687.929315:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951688.056584:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951688.056608:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624337792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951688.056687:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951688.056827:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624337792 00000100:00100000:1.0:1783951688.056847:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624337792 00000100:00100000:1.0:1783951688.056911:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783951688.056919:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624337792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951688.056959:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951688.057028:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624337792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951688.057035:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783951688.057084:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624337792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783951688.057340:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783951688.952419:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951689.078304:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624338048:0@lo:400:kworker.0 00000100:00100000:3.0:1783951689.078387:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624338176:0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.078389:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951689.078445:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951689.078445:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624338560:0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.078470:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951689.078475:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951689.078481:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624338304:0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.078487:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783951689.078506:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624337920:0@lo:400:kworker.0 00000100:00100000:3.0:1783951689.078516:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951689.078531:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951689.078549:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624338048 00000100:00100000:1.0:1783951689.078549:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624338432:0@lo:400:kworker.0 00000100:00100000:3.0:1783951689.078557:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624338048 00000100:00100000:1.0:1783951689.078572:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951689.078609:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624338176 00000100:00100000:3.0:1783951689.078613:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624338176 00000100:00100000:0.0:1783951689.078694:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624337920 00000100:00100000:0.0:1783951689.078715:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624337920 00000100:00100000:0.0:1783951689.078749:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1783951689.078758:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951689.078846:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3313:x1870608624337920:12345-0@lo:400:kworker.0 Request processed in 88us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951689.078854:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1783951689.078922:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624338560 00000100:00100000:0.0:1783951689.078927:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624338560 00000100:00100000:0.0:1783951689.078954:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624338304 00000100:00100000:0.0:1783951689.078957:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624338304 00000100:00100000:0.0:1783951689.078977:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783951689.078983:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624338560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951689.079014:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624338560:12345-0@lo:400:kworker.0 Request processed in 32us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951689.079020:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783951689.079032:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783951689.079038:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624338304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951689.079077:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624338304:12345-0@lo:400:kworker.0 Request processed in 39us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951689.079082:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783951689.079446:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624338304:0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.087150:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624338432 00000100:00100000:1.0:1783951689.087170:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624338432 00000100:00100000:1.0:1783951689.087257:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783951689.087268:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624338048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.087364:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624338048:12345-0@lo:400:kworker.0 Request processed in 98us (8974us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951689.087371:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783951689.087403:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783951689.087409:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624338176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.087459:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624338176:12345-0@lo:400:kworker.0 Request processed in 49us (9013us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951689.087464:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783951689.087477:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783951689.087483:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624338432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.087533:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624338432:12345-0@lo:400:kworker.0 Request processed in 51us (8960us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951689.087540:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783951689.087606:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3313:1870608624337920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.087631:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624338432:0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.087641:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624338048:0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.087650:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624338560:0@lo:400:kworker.0 00000100:00100000:1.0:1783951689.087712:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624338176:0@lo:400:kworker.0 00000100:00080000:1.0:1783951689.087742:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951689.087746:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951689.105682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951689.105727:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602340224 00000100:00100000:1.0:1783951689.105737:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602340224 00000100:00100000:1.0:1783951689.105799:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:1.0:1783951689.105837:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+10:2360:x1870608602340224:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951689.105855:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951689.105878:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5e200/0x443dabd358eec42b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03855d expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951689.110018:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951689.110115:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:2360:x1870608602340224:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 4299us (4446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951689.110129:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783951689.113103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951689.113144:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602340480 00000100:00100000:0.0:1783951689.113154:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602340480 00000100:00100000:0.0:1783951689.113214:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1783951689.113223:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86850dbf-e7ae-4b99-b87c-55f16448ce1f+9:2360:x1870608602340480:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951689.113251:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951689.113270:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d40031800/0x443dabd358eec5f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03860c expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951689.113288:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951689.113334:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:2360:x1870608602340480:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 112us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951689.113341:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1783951689.113422:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951689.113441:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602340352 00000100:00100000:0.0:1783951689.113445:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602340352 00000100:00100000:0.0:1783951689.113470:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1783951689.113477:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+8:2360:x1870608602340352:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951689.113486:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951689.113512:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5e800/0x443dabd358eec432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038587 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951689.113522:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951689.113541:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86850dbf-e7ae-4b99-b87c-55f16448ce1f+7:2360:x1870608602340352:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951689.113548:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:1.0:1783951689.115388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951689.115426:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602340736 00000100:00100000:1.0:1783951689.115435:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602340736 00000100:00100000:1.0:1783951689.116550:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 241 00000100:00100000:1.0:1783951689.116566:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+6:2357:x1870608602340736:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:1.0:1783951689.116611:0:5792:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec440 00000020:00010000:1.0:1783951689.116620:0:5792:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8d75772800: total 0 00000100:00080000:1.0:1783951689.116625:0:5792:0:(import.c:65:import_set_state_nolock()) ffff8e8d75770800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951689.116650:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1783951689.118293:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5168f61-b22b-4094-aa34-e52db03426e1+5:2357:x1870608602340736:12345-192.168.201.6@tcp:39:umount.0 Request processed in 1723us (2908us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1783951689.118307:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 241 00000100:00080000:1.0:1783951689.118373:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1783951689.118384:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8d75772800: total 0 00010000:00010000:1.0:1783951689.118429:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8d75772800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783951689.118467:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d821cfe00) 00010000:00010000:1.0:1783951689.118471:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951689.118478:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed36d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389bd expref: 4 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951689.118508:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8d75772800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783951689.118520:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951689.118534:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951689.118535:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951689.142637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951689.146956:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602340992 00000100:00100000:0.0:1783951689.146974:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602340992 00000100:00100000:0.0:1783951689.147044:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 301 00000100:00100000:0.0:1783951689.147064:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+7:2357:x1870608602340992:12345-192.168.201.6@tcp:251:umount.0 00000020:00000080:0.0:1783951689.147107:0:5786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec336 00000020:00010000:0.0:1783951689.147115:0:5786:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8d79d94000: total 0 00000100:00080000:0.0:1783951689.147134:0:5786:0:(import.c:65:import_set_state_nolock()) ffff8e8d79d90800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783951689.147217:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86850dbf-e7ae-4b99-b87c-55f16448ce1f+3:2357:x1870608602340992:12345-192.168.201.6@tcp:251:umount.0 Request processed in 164us (4599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951689.147226:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 301 00000020:00010000:3.0:1783951689.147846:0:8311:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8d79d94000: total 0 00010000:00010000:3.0:1783951689.147851:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951689.147892:0:8311:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8d79d94000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783951689.147936:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165f800/0x443dabd358eec3ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a03854f expref: 2 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951689.147954:0:8311:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8d79d94000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1783951689.147963:0:8311:0:(genops.c:906:class_export_put()) final put ffff8e8d79d94000/86850dbf-e7ae-4b99-b87c-55f16448ce1f 00010000:00010000:3.0:1783951689.147977:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951689.147979:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951689.147981:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783951689.148390:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d79d94000/86850dbf-e7ae-4b99-b87c-55f16448ce1f for MGS 00000020:00000080:0.0:1783951689.148435:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d79d90800 for MGS 00000001:00100000:0.0:1783951689.151439:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:0.0:1783951689.151450:0:7503:0:(genops.c:906:class_export_put()) final put ffff8e8d448ca000/65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:1.0:1783951689.151553:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d448ca000/65c652b5-a392-4c36-a8f6-f2bd53c90279 for lustre-OST0001 00000020:00000080:1.0:1783951689.151713:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d448cf800 for lustre-OST0001 00000100:00100000:3.0:1783951689.614972:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951689.615006:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d76db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624338688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951689.615092:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951689.615375:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624338688 00000100:00100000:1.0:1783951689.615386:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624338688 00000100:00100000:1.0:1783951689.615442:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783951689.615451:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624338688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951689.615499:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951689.615552:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624338688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951689.615560:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783951689.615671:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d76db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624338688:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783951689.977325:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783951690.188947:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000001:00080000:3.0:1783951690.188968:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1783951690.188992:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a5168f61-b22b-4094-aa34-e52db03426e1 00000001:00080000:3.0:1783951690.189000:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1783951690.189004:0:5813:0:(genops.c:906:class_export_put()) final put ffff8e8d75772800/a5168f61-b22b-4094-aa34-e52db03426e1 00000020:00000080:3.0:1783951690.189036:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d75772800/a5168f61-b22b-4094-aa34-e52db03426e1 for lustre-MDT0000 00000020:00000080:3.0:1783951690.189104:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d75770800 for lustre-MDT0000 00000020:00000080:3.0:1783951690.189182:0:5813:0:(genops.c:906:class_export_put()) final put ffff8e8d79d97000/65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:3.0:1783951690.189210:0:477:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d79d97000/65c652b5-a392-4c36-a8f6-f2bd53c90279 for lustre-MDT0000 00000020:00000080:3.0:1783951690.189250:0:477:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d79d92000 for lustre-MDT0000 00000001:00100000:2.0:1783951690.286914:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:2.0:1783951690.286926:0:6615:0:(genops.c:906:class_export_put()) final put ffff8e8d452ec000/65c652b5-a392-4c36-a8f6-f2bd53c90279 00000020:00000080:1.0:1783951690.287386:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d452ec000/65c652b5-a392-4c36-a8f6-f2bd53c90279 for lustre-OST0000 00000020:00000080:1.0:1783951690.287438:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d452eb000 for lustre-OST0000 00010000:00010000:3.0:1783951690.998594:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951691.127330:0:11551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951691.127340:0:11551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951691.127896:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1783951691.127905:0:11551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:0.0:1783951691.697850:0:12888:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783951691.728664:0:12888:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783951691.728727:0:12888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.728743:0:12888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.728751:0:12888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.728759:0:12888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.728784:0:12888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783951691.728789:0:12888:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783951691.728834:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783951691.728838:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783951691.728843:0:12888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783951691.728876:0:12888:0:(import.c:65:import_set_state_nolock()) ffff8e8d73cde000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783951691.729391:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951691.729398:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.729407:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff8e00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951691.729412:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.729420:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951691.729427:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951691.729433:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783951691.729435:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783951691.729438:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783951691.729479:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.729486:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951691.729517:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.729552:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff8e00/0x443dabd358eec3bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.729565:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951691.729566:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951691.729568:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951691.730161:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951691.730185:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624338944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951691.730263:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951691.730338:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624338944 00000100:00100000:2.0:1783951691.730345:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624338944 00000100:00100000:2.0:1783951691.730405:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783951691.730415:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d60b38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3314:x1870608624338944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951691.730428:0:8312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951691.730457:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d41513e00/0x443dabd358eec3c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec3bb expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.730473:0:8312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951691.730511:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d60b38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3314:x1870608624338944:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951691.730518:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951691.730518:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624338816:0@lo:39:umount.0 00000100:00100000:1.0:1783951691.730550:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951691.730582:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624338816 00000100:00100000:1.0:1783951691.730585:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624338816 00000100:00100000:1.0:1783951691.730635:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783951691.730644:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870608624338816:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783951691.730676:0:8068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec145 00000100:00080000:1.0:1783951691.730684:0:8068:0:(import.c:65:import_set_state_nolock()) ffff8e8d56291800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783951691.730740:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1870608624338816:12345-0@lo:39:umount.0 Request processed in 97us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951691.730746:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1783951691.730753:0:8068:0:(genops.c:906:class_export_put()) final put ffff8e8d56291000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1783951691.730790:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d73cde000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1783951691.730795:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951691.730800:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624338816:0@lo:39:umount.0 00000100:00080000:3.0:1783951691.730830:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783951691.730833:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951691.730904:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624338944:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1783951691.731392:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d56291000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783951691.731453:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d56291800 for lustre-MDT0000 00000100:00100000:3.0:1783951691.731989:0:12888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783951691.734326:0:12888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.734345:0:12888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.734352:0:12888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.734360:0:12888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.734384:0:12888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951691.734390:0:12888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.734397:0:12888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.734403:0:12888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.734409:0:12888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.734427:0:12888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951691.734433:0:12888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734474:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951691.734481:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734489:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4a00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951691.734493:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734502:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951691.734525:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951691.734532:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783951691.734534:0:8310:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1783951691.734568:0:8310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734574:0:8310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951691.734596:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734603:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eec3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734614:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951691.734617:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734622:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5ee00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951691.734625:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734644:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951691.734716:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951691.734724:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783951691.734731:0:8310:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783951691.734733:0:8310:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783951691.734761:0:8310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734768:0:8310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951691.734774:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734780:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ee00/0x443dabd358eec2f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec2f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951691.734793:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951691.734795:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951691.734797:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951691.734864:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951691.734883:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624339072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951691.734948:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951691.735006:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951691.735013:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624339200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951691.735037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951691.735289:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624339072 00000100:00100000:0.0:1783951691.735297:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624339072 00000100:00100000:0.0:1783951691.735342:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624339200 00000100:00100000:0.0:1783951691.735345:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624339200 00000100:00100000:0.0:1783951691.735367:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783951691.735375:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+19:3312:x1870608624339072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951691.735388:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951691.735409:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff8a00/0x443dabd358eec3d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec3c9 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.735422:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951691.735469:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+18:3312:x1870608624339072:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951691.735477:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783951691.735497:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951691.735503:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:3312:x1870608624339200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951691.735510:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951691.735518:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d60d5fa00/0x443dabd358eec2f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec2f0 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.735529:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951691.735550:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:3312:x1870608624339200:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951691.735555:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951691.735590:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624339200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951691.735599:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624339072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951691.738876:0:12888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.738885:0:12888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.738892:0:12888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.738920:0:12888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951691.738928:0:12888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.738934:0:12888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.738939:0:12888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.738945:0:12888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951691.738965:0:12888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783951691.738970:0:12888:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783951691.738977:0:12888:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1783951691.738994:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951691.739002:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783951691.739007:0:12888:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1783951691.739010:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d40030e00 already unused, calling callback (ffffffffc1d34c20) 00000020:01000000:3.0:1783951691.739012:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:0.0:1783951691.739013:0:8311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783951691.739016:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1783951691.739020:0:8311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783951691.739021:0:12888:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1783951691.739035:0:12888:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8e8d7c11d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:0.0:1783951691.739036:0:8311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951691.739041:0:12888:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8e8d7faae000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:0.0:1783951691.739042:0:8311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783951691.739045:0:8311:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:00080000:3.0:1783951691.739046:0:12888:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8e8d79fb8000) has exports, disconnecting them 10000000:01000000:0.0:1783951691.739046:0:8311:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:3.0:1783951691.739064:0:12888:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e8d7c11d000), last request at 1783951689 00000020:00000080:3.0:1783951691.739071:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec2b8 00000100:00080000:3.0:1783951691.739087:0:12888:0:(import.c:65:import_set_state_nolock()) ffff8e8d7c11d800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783951691.739097:0:8311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.739103:0:8311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951691.739125:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.739131:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d40030e00/0x443dabd358eec5e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec5eb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951691.739143:0:12888:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8d7c11d000): rc 0 00010000:00010000:0.0:1783951691.739143:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:3.0:1783951691.739146:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d7c11d000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1783951691.739146:0:8311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.739151:0:8311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5ec00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951691.739154:0:8311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951691.739156:0:12888:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e8d7faae000), last request at 1783951689 00000020:00000080:3.0:1783951691.739160:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec1ed 00010000:00010000:0.0:1783951691.739162:0:8311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783951691.739164:0:12888:0:(import.c:65:import_set_state_nolock()) ffff8e8d7faab800 : changing import state from FULL to CLOSED 10000000:00010000:0.0:1783951691.739168:0:8311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951691.739172:0:12888:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8d7faae000): rc 0 00000020:00000080:3.0:1783951691.739174:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d7faae000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1783951691.739180:0:12888:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb7fa40dabae0 10000000:01000000:0.0:1783951691.739183:0:8311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783951691.739185:0:8311:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783951691.739187:0:8311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:3.0:1783951691.739198:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951691.739201:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00010000:00010000:0.0:1783951691.739201:0:8311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.739206:0:8311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:3.0:1783951691.739211:0:12888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1783951691.739212:0:8311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.739218:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ec00/0x443dabd358eec0a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec0ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.739231:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951691.739232:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951691.739234:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951691.739248:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624339456:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783951691.739268:0:12888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783951691.739279:0:12888:0:(import.c:65:import_set_state_nolock()) ffff8e8d601c1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783951691.739288:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951691.739290:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1783951691.739297:0:12888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951691.739308:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783951691.739348:0:12888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1783951691.739348:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951691.739353:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a1caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624339328:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783951691.739354:0:12888:0:(import.c:65:import_set_state_nolock()) ffff8e8d7f750000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783951691.739372:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783951691.739392:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8e8d79fb8000) has no exports 00000020:00000080:0.0:1783951691.739392:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7c11d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783951691.739434:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7faae000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783951691.739465:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d7c11d800 for lustre-MDT0000 00000020:00000080:0.0:1783951691.739469:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d7faab800 for lustre-MDT0000 00010000:00010000:0.0:1783951691.739553:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951691.739567:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624339456 00000100:00100000:0.0:1783951691.739573:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624339456 00000100:00100000:0.0:1783951691.739619:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624339328 00000100:00100000:0.0:1783951691.739622:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624339328 00000100:00100000:1.0:1783951691.739742:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624339584:0@lo:9:umount.0 00000100:00100000:1.0:1783951691.739775:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951691.739796:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624339584 00000100:00100000:1.0:1783951691.739799:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624339712:0@lo:9:umount.0 00000100:00100000:3.0:1783951691.739800:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624339584 00000100:00100000:1.0:1783951691.739842:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951691.739860:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624339712 00000100:00100000:3.0:1783951691.739869:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624339712 00000100:00080000:1.0:1783951691.739870:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951691.739876:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951691.739880:0:5787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951691.739895:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783951691.739902:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1870608624339584:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783951691.739924:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec248 00000100:00080000:3.0:1783951691.739929:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8d80e94800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951691.739967:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783951691.739998:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951691.740005:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+17:3315:x1870608624339456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951691.740015:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951691.740028:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d40030200/0x443dabd358eec0ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec0a4 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.740041:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951691.740074:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+16:3315:x1870608624339456:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951691.740081:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951691.740097:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783951691.740102:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+15:3315:x1870608624339328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951691.740109:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951691.740116:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d40031a00/0x443dabd358eec5eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec5e4 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951691.740125:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951691.740145:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da93b96-3ed4-473a-afe6-6e7d7d0f924f+14:3315:x1870608624339328:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951691.740150:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783951691.740171:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783951691.740177:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1870608624339712:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783951691.740192:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec321 00000100:00080000:0.0:1783951691.740197:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8e8d7f756000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951691.740217:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1783951691.740287:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3311:x1870608624339584:12345-0@lo:9:umount.0 Request processed in 385us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951691.740293:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783951691.740415:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3311:x1870608624339712:12345-0@lo:9:umount.0 Request processed in 236us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951691.740427:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1783951691.740464:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951691.740488:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a1caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624339328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951691.740497:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3315:1870608624339456:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783951691.740682:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d601c1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951691.740699:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951691.740701:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951691.740704:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624339584:0@lo:9:umount.0 00000100:00080000:1.0:1783951691.740725:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d7f750000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951691.740737:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951691.740738:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951691.740741:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624339712:0@lo:9:umount.0 00010000:00010000:1.0:1783951691.740759:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951691.741095:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783951691.749749:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8e8d79fb8000) has no exports 00000020:00000080:0.0:1783951691.813021:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec0ff 00000020:00000080:0.0:1783951691.813036:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d8146b000/lustre-QMT0000_UUID 00000020:01000000:0.0:1783951691.813228:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783951691.815922:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d8146b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783951691.819126:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951691.819142:0:12888:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783951691.819147:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8e8d79fbcd40) has no exports 00000020:00000080:2.0:1783951691.819520:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec0f8 00000020:00000080:2.0:1783951691.819529:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d60a1e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783951691.819599:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951691.819608:0:12888:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783951691.819611:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d60a18000/lustre-QMT0000_UUID 00000020:00000080:2.0:1783951691.819613:0:12888:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d60a18000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783951691.819622:0:12888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1783951691.819935:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d60a1e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783951691.819979:0:12888:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8d81218f60 - data ffff8e8d6677a000/ffff8e8d757ac800 00000020:01000000:2.0:1783951691.820117:0:12888:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8d65cff6c0 - data ffff8e8d667691b0/ffff8e8d76dac000 00000001:00000004:3.0:1783951691.833896:0:12888:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1783951691.935644:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783951691.935655:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1783951691.935676:0:12888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951691.935680:0:12888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783951691.938509:0:6776:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783951691.938517:0:6776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1783951691.938528:0:6776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1783951691.940465:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783951691.940472:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1783951691.940490:0:12888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951691.940493:0:12888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783951691.941268:0:7917:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783951691.941273:0:7917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1783951691.941282:0:7917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:3.0:1783951692.021945:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783951692.065783:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec0c7 00000020:00000080:2.0:1783951692.065840:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d7a1d7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783951692.066327:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7a1d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951692.067623:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec0dc 00000020:00000080:2.0:1783951692.067632:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d50290000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783951692.067682:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783951692.067688:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951692.067696:0:12888:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783951692.067700:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8e8d79fbb380) has no exports 00000004:01000000:2.0:1783951692.067886:0:12888:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783951692.067894:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec31a 00000020:00000080:2.0:1783951692.067899:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d76e9e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951692.070645:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d50290000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1783951692.075121:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d76e9e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783951692.075185:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783951692.080924:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951692.080956:0:12888:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783951692.080962:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8e8d7c1d99c0) has no exports 00000020:00000080:3.0:1783951692.080972:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec313 00000020:00000080:3.0:1783951692.080981:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d7f755800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783951692.081331:0:12888:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783951692.081336:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951692.081340:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1783951692.081345:0:12888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951692.081347:0:12888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951692.081382:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951692.081390:0:12888:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951692.081396:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec233 00000020:00000080:3.0:1783951692.081401:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d80e90000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783951692.081409:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783951692.081413:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951692.081417:0:12888:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951692.081419:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8e8d7f850000) has no exports 00000020:00000080:3.0:1783951692.081423:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec22c 00000020:00000080:3.0:1783951692.081446:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d601c1800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783951692.081713:0:12888:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783951692.081716:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951692.081719:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1783951692.081722:0:12888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951692.081723:0:12888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951692.081744:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951692.081749:0:12888:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951692.081776:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951692.081779:0:12888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951692.081782:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d4535c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951692.081785:0:12888:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d4535c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783951692.081796:0:12888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951692.081966:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec0e3 00000020:00000080:3.0:1783951692.081971:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d50292000/lustre-MDD0000_UUID 00000020:01000000:3.0:1783951692.081975:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783951692.081979:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951692.081982:0:12888:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783951692.081985:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8e8d79fb99c0) has no exports 00000020:00000080:3.0:1783951692.082001:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951692.082004:0:12888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783951692.082007:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec0ea 00000020:00000080:3.0:1783951692.082010:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d7a1d1000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783951692.082016:0:12888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8d4535a000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1783951692.082019:0:12888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d4535a000 3 00000020:01000004:3.0:1783951692.082021:0:12888:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8d4535a000 from lustre-MDT0000 00000020:00000080:3.0:1783951692.082039:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951692.082043:0:12888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1783951692.082045:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d7a1d4000/lustre-MDT0000_UUID 00000020:00000080:3.0:1783951692.082047:0:12888:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7a1d4000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1783951692.082053:0:12888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1783951692.082076:0:12888:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1783951692.082087:0:12888:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1783951692.082090:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1783951692.082093:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951692.082095:0:12888:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783951692.082102:0:12888:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8e8d5029c800 8da93b96-3ed4-473a-afe6-6e7d7d0f924f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951692.082107:0:12888:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8e8d585e3380) has exports, disconnecting them 00000020:00080000:3.0:1783951692.082110:0:12888:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e8d5029c800), last request at 1783951472 00000020:00000080:3.0:1783951692.082123:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec088 00000020:00010000:3.0:1783951692.082127:0:12888:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8d5029c800: total 5 00000100:00080000:3.0:1783951692.082131:0:12888:0:(import.c:65:import_set_state_nolock()) ffff8e8d5029e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783951692.082141:0:12888:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8d5029c800): rc 0 00000020:00080000:3.0:1783951692.082145:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8e8d585e3380) has no exports 00000020:00010000:0.0:1783951692.082246:0:5780:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8d5029c800: total 5 00010000:00010000:0.0:1783951692.082276:0:5780:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8d5029c800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1783951692.082301:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce5000/0x443dabd358eec38a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec383 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951692.082318:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff9a00/0x443dabd358eec398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec391 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951692.082338:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce4e00/0x443dabd358eec3a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec39f expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951692.082348:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff9000/0x443dabd358eec3b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec3ad expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951692.082358:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eec5cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec5c8 expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951692.082367:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165fc00/0x443dabd358eec3de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec3d7 expref: 4 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951692.082379:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d74ff9400/0x443dabd358eec5dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec5d6 expref: 3 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951692.082390:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d4165e800/0x443dabd358eec1a0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x443dabd358eec199 expref: 2 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951692.082400:0:5780:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8d5029c800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1783951692.082411:0:5780:0:(genops.c:906:class_export_put()) final put ffff8e8d5029c800/8da93b96-3ed4-473a-afe6-6e7d7d0f924f 00010000:00010000:0.0:1783951692.082417:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951692.082419:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951692.082420:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951692.082457:0:5784:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e8d45334600:5784] 0 exiting: rc = 1 00000100:00100000:0.0:1783951692.082543:0:5786:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e8d58528400:5786] 2 exiting: rc = 0 00000020:00000080:2.0:1783951692.083544:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7f755800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951692.083557:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d7f750000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783951692.083565:0:36:0:(genops.c:906:class_export_put()) final put ffff8e8d757bd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951692.083567:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d757bd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783951692.083571:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951692.083629:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d80e90000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783951692.083635:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d601c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951692.083639:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d601c1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783951692.083643:0:36:0:(genops.c:906:class_export_put()) final put ffff8e8d80e93000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951692.083645:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d80e93000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783951692.083649:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951692.083719:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d50292000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783951692.083724:0:36:0:(genops.c:906:class_export_put()) final put ffff8e8d7a1d3000/lustre-MDD0000_UUID 00000020:00000080:2.0:1783951692.083726:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7a1d3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783951692.083731:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783951692.084012:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7a1d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951692.084017:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d5029c800/8da93b96-3ed4-473a-afe6-6e7d7d0f924f for MGS 00000100:00100000:1.0:1783951692.084171:0:5785:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e8d58528c00:5785] 1 exiting: rc = 0 00000100:00100000:1.0:1783951692.084271:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084279:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084286:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084291:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084298:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084303:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084310:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084326:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084333:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084339:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084346:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084352:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084358:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084363:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084369:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084375:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084380:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084386:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084392:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084397:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084403:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084408:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084414:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084419:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084424:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084430:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084436:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084452:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084458:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084463:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084468:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084474:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084479:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084485:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084490:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084496:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084501:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084506:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084510:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084516:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084522:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084527:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084539:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084545:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084550:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084556:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084561:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084567:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084571:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084577:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084582:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084587:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084592:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084596:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084602:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084607:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084613:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084620:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084626:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084632:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084637:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084642:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084647:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951692.084653:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1783951692.085534:0:12888:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783951692.085539:0:12888:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1783951692.098532:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d5029e800 for MGS 00000020:01000000:3.0:1783951692.098645:0:12888:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8d81218d80 - data ffff8e8d6673b438/ffff8e8d757ae000 00000020:01000000:3.0:1783951692.098765:0:12888:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8d605a31e0 - data ffff8e8d66738438/ffff8e8d4568f400 00000020:00000080:3.0:1783951692.099299:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec06c 00000020:00000080:3.0:1783951692.099308:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d5063c800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783951692.099324:0:12888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8d4535a000 from MGS, refs=2 00000020:01000004:3.0:1783951692.099327:0:12888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d4535a000 2 00000020:01000004:3.0:1783951692.099330:0:12888:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8d4535a000 from MGS 00000020:00000080:3.0:1783951692.099350:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951692.099357:0:12888:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783951692.099360:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d60d86800/MGS 00000020:00000080:3.0:1783951692.099363:0:12888:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d60d86800/MGS for MGS 00000020:01000000:3.0:1783951692.099369:0:12888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783951692.099422:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783951692.099426:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951692.099432:0:12888:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783951692.099447:0:12888:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e8d8122b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951692.099453:0:12888:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8e8d65ab3380) has exports, disconnecting them 00000020:00080000:3.0:1783951692.099459:0:12888:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e8d8122b800), last request at 1783951473 00000020:00000080:3.0:1783951692.099463:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec137 00000020:00080000:3.0:1783951692.099482:0:12888:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8d8122b800): rc 0 00000020:00000080:3.0:1783951692.099487:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d8122b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783951692.100559:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d5063c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951692.100578:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d8122b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783951692.101042:0:12888:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783951692.101048:0:12888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951692.101051:0:12888:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783951692.101058:0:12888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783951692.101079:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d73cde000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783951692.101288:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951692.101295:0:12888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783951692.101300:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d80e93800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783951692.101302:0:12888:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d80e93800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783951692.101307:0:12888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783951692.101361:0:12888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d4535a000 1 00000020:00000080:2.0:1783951692.101367:0:12888:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec05e 00000020:00000080:2.0:1783951692.101371:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d50912800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1783951692.101382:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783951692.101390:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d50912800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951692.101398:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951692.101403:0:12888:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783951692.101406:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8e8d585e4d40) has no exports 00000020:00000080:0.0:1783951692.224693:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951692.224708:0:12888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783951692.224714:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d45358800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783951692.224718:0:12888:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d45358800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783951692.224739:0:12888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783951692.224869:0:12888:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e8d4535e000 00000020:01000000:0.0:1783951692.224892:0:12888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1783951692.224897:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951692.224902:0:12888:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951692.224906:0:12888:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8e8d585e19c0) has no exports 00000100:00100000:2.0:1783951692.229778:0:5793:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8e8d456a4800:5793] 2 exiting: rc = 0 00000100:00100000:1.0:1783951692.229947:0:5792:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8e8d456a5400:5792] 1 exiting: rc = 0 00000100:00100000:1.0:1783951692.230037:0:8068:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8e8d45adce00:8068] 3 exiting: rc = 0 00000100:00100000:2.0:1783951692.230299:0:5791:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8e8d58dc7800:5791] 0 exiting: rc = 1 00000100:00100000:0.0:1783951692.234525:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234541:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234547:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234552:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234557:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234564:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234571:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234577:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234584:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234589:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234594:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234600:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234605:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234610:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234615:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234620:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234625:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234630:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234636:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234642:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234647:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234653:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234659:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234665:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234671:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234677:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234682:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234688:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234694:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234719:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234725:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234730:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234735:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234740:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234746:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234752:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234758:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234763:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234769:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234774:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234780:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234786:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234792:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234798:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234803:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234835:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234842:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234848:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234855:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234860:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234866:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234871:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234876:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234880:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234885:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234889:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234895:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234901:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234910:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234915:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234920:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234926:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.234931:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.235035:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.244017:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e8d456a4a00:5795] 1 exiting: rc = 0 00000100:00100000:2.0:1783951692.245333:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e8d456a4000:5794] 0 exiting: rc = 1 00000100:00100000:0.0:1783951692.246479:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246488:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246494:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246500:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246505:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246512:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246518:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246523:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246528:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246535:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246541:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246546:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246552:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246559:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246563:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246569:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246573:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246578:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246584:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246589:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246594:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246599:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246604:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246609:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246614:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246618:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246624:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246629:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246634:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246639:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246644:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246650:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246655:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246660:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246666:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246684:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246689:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246694:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246699:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246705:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246710:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246716:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246722:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246727:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246732:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246737:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246742:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246747:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246752:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246756:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246762:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246767:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246773:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246778:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246783:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246800:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246805:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246832:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246837:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246842:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246847:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246852:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246858:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.246863:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.251850:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8e8d45993a00:5796] 0 exiting: rc = 1 00000100:00100000:3.0:1783951692.255378:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8e8d45993000:5797] 1 exiting: rc = 0 00000100:00100000:0.0:1783951692.255493:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255533:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255545:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255552:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255594:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255601:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255619:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255627:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255632:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255638:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255644:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255651:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255656:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255680:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255687:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255692:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255697:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255703:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255709:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255715:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255721:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255726:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255732:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255738:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255743:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255762:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255769:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255774:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255780:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255785:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255791:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255797:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255803:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255838:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255854:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255860:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255865:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255885:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255893:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255899:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255905:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255917:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255922:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255927:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255933:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255951:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255957:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255964:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255969:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.255988:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256001:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256008:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256014:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256020:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256026:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256032:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256158:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256167:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256173:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256178:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256184:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256218:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256227:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.256235:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278659:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e8d45993200:5798] 0 exiting: rc = 1 00000100:00100000:2.0:1783951692.278781:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e8d45992600:5799] 1 exiting: rc = 0 00000100:00100000:2.0:1783951692.278877:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278884:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278900:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278905:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278910:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278915:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278920:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278925:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.278930:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279441:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279451:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279456:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279460:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279465:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279469:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279474:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279479:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279483:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279488:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279492:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279497:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279501:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279506:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279510:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279514:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279520:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279525:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279530:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279535:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279540:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279546:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279552:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279557:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279561:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279566:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279571:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279576:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279592:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279597:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279602:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279607:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279612:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279617:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279621:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279635:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279640:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279645:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279651:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279656:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279660:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279665:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279669:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279674:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279679:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279684:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279689:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279693:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279698:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279703:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279708:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279714:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279718:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279723:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.279728:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.292443:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e8d45992200:5801] 1 exiting: rc = 0 00000100:00100000:1.0:1783951692.301466:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e8d45992800:5800] 0 exiting: rc = 1 00000100:00100000:0.0:1783951692.307147:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307158:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307163:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307168:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307173:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307177:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307182:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307186:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307883:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307896:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307901:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307924:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307928:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.307933:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308006:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308013:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308018:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308025:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308030:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308034:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308116:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308124:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308130:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308135:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308140:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308144:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308149:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308154:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308160:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308165:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308171:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308177:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308182:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308186:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308292:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308300:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308306:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308311:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308316:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308481:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308487:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308493:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308498:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308504:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308509:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308513:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308528:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308532:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308537:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308541:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308546:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308551:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308556:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308560:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308565:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308570:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308581:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308587:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308878:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308885:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308889:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308894:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308898:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.308903:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.309681:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e8d45992a00:5802] 0 exiting: rc = 1 00000100:00100000:2.0:1783951692.309769:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e8d45993600:5803] 1 exiting: rc = 0 00000100:00100000:0.0:1783951692.312086:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312097:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312102:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312106:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312111:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312116:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312120:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312125:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312130:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312136:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312141:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312146:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312151:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312156:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312161:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312167:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312171:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312208:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312213:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312218:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312223:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312227:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312233:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312238:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312242:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312247:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312252:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312257:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312262:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312267:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312272:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312277:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312281:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312286:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312291:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312298:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312302:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312308:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312313:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312317:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312322:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312326:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312331:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312336:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312340:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312344:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312349:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312354:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312358:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312363:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312368:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312373:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312385:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312390:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312395:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312400:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312404:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312409:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312415:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312419:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312424:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312430:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312452:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.312459:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951692.313241:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8e8d456a5800:5804] 0 exiting: rc = 1 00000100:00100000:1.0:1783951692.315532:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8e8d456a4e00:5805] 1 exiting: rc = 0 00000100:00100000:1.0:1783951692.317243:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8e8d456a4c00:5806] 2 exiting: rc = 0 00000100:00100000:0.0:1783951692.321689:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321701:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321707:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321712:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321717:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321723:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321753:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321761:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321766:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321772:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321778:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321784:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321789:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321796:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321803:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321834:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321841:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321846:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321852:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321857:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321864:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321870:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321875:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321893:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321898:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321904:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321910:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321915:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321921:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.321926:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322033:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322049:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322056:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322062:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322068:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322074:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322079:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322084:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322091:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322097:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322103:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322110:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322116:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322122:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322129:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322136:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322144:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322150:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322156:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322163:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322169:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322175:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322181:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322187:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322322:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322330:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322336:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322341:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322354:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322359:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322365:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322371:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322375:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951692.322389:0:12888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783951692.335590:0:12888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951692.335605:0:12888:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783951692.335611:0:12888:0:(genops.c:906:class_export_put()) final put ffff8e8d50290800/MDS_uuid 00000020:00000080:2.0:1783951692.335616:0:12888:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d50290800/MDS_uuid for MDS 00000020:01000000:2.0:1783951692.335629:0:12888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783951692.335805:0:12888:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1783951693.046062:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951694.075261:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951694.199250:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624339840:0@lo:400:kworker.0 00000400:00000100:3.0:1783951694.199306:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870608624339840 offset 0 length 224: 4 00000100:00100000:3.0:1783951694.199354:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951694.199361:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624339968:0@lo:400:kworker.0 00000400:00000100:3.0:1783951694.199379:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870608624339968 offset 0 length 224: 4 00000100:00100000:3.0:1783951694.199412:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624340096:0@lo:400:kworker.0 00000400:00000100:3.0:1783951694.199430:0:3314:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870608624340096 offset 0 length 224: 4 00000001:00100000:0.0:1783951694.265682:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951694.265702:0:7503:0:(genops.c:906:class_export_put()) final put ffff8e8d7f754800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951694.268394:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7f754800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783951694.268482:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d7f756000 for lustre-OST0001 00010000:00010000:3.0:1783951695.097245:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783951695.278913:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951695.278923:0:6615:0:(genops.c:906:class_export_put()) final put ffff8e8d80e96800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951695.281579:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d80e96800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783951695.281650:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d80e94800 for lustre-OST0000 00000020:01000004:1.0:1783951695.918345:0:13040:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783951695.940989:0:13040:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1783951695.941042:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951695.941079:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951695.941086:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951695.941093:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951695.941113:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783951695.941118:0:13040:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1783951695.941128:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951695.941136:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951695.941140:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1783951695.941142:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41513400 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951695.941146:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951695.941150:0:13040:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8d81338a80 x1870608624339968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783951695.941155:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951695.941162:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951695.941167:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783951695.941170:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783951695.941172:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1783951695.941175:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783951695.941181:0:13040:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783951695.941203:0:13040:0:(import.c:65:import_set_state_nolock()) ffff8e8d7faaf800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783951695.941207:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951695.941213:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951695.941231:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951695.941244:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d41513400/0x443dabd358eec39f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x443dabd358eec3a6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951695.941255:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1783951695.941255:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951695.941257:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951695.941259:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951695.941271:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624340224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951695.941330:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951695.941461:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624340224 00000100:00100000:0.0:1783951695.941468:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624340224 00000100:00100000:0.0:1783951695.941516:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951695.941524:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1870608624340224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783951695.941529:0:5778:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951695 with bad export cookie 4917275292376940680 00000100:00100000:2.0:1783951695.941570:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1870608624340352:0@lo:39:umount.0 00000400:00000100:2.0:1783951695.941596:0:3311:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870608624340352 offset 0 length 224: 4 00000100:00100000:3.0:1783951695.941918:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624339968:0@lo:400:kworker.0 00000100:00100000:2.0:1783951695.962222:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1870608624340224:12345-0@lo:103:ldlm_bl.0 Request processed in 20689us (20883us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783951695.962238:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1783951695.962364:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951695.962380:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8e8d50297000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783951695.962384:0:3314:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783951695.971633:0:3314:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.106@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783951695.971640:0:3314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783951695.971649:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8d8133aa00 x1870608624339840/t0(0) o400->MGC192.168.201.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951695.971692:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8d65af0a80 x1870608624340224/t0(0) o103->MGC192.168.201.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951711 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783951695.971702:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783951695.971705:0:3314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783951695.971706:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783951695.971710:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8e8d50297000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951695.971714:0:3314:0:(import.c:510:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1783951695.971724:0:3314:0:(import.c:624:import_select_connection()) MGC192.168.201.106@tcp: import ffff8e8d50297000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783951695.971754:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d811a7480 x1870608624340480/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951695.971799:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3311:1870608624340480:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1783951695.971869:0:3311:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870608624340480 offset 0 length 520: 4 00000100:00100000:0.0:1783951695.971969:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3312:1870608624339840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951695.972096:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3314:1870608624340224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951696.120995:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951697.142839:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951698.166449:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951699.189983:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951699.320553:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951699.320562:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783951699.321022:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624340608:0@lo:400:kworker.0 00000400:00000100:0.0:1783951699.321077:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870608624340608 offset 0 length 224: 4 00010000:00010000:1.0:1783951700.214926:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951700.346092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951700.346105:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783951700.348007:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951700.348037:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624340736:0@lo:400:kworker.0 00000400:00000100:0.0:1783951700.348107:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870608624340736 offset 0 length 224: 4 00010000:00010000:2.0:1783951701.238020:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951702.262721:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951703.285998:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951704.311786:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951705.334324:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951705.465286:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951695/real 1783951695] req@ffff8e8d811a7480 x1870608624340480/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951705.465320:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8d811a7480 x1870608624340480/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951705.465332:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951695/real 1783951695] req@ffff8e8d811a4a80 x1870608624340352/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951705.465362:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8d811a4a80 x1870608624340352/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951705.465378:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d50297000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951705.465389:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783951705.465393:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3311:1870608624340480:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1783951705.465401:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d7faaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783951705.465420:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1870608624340352:0@lo:39:umount.0 00000100:00080000:1.0:1783951705.465572:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783951705.465579:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783951705.465585:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783951705.466509:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951705.466527:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951705.466535:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951705.466555:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951705.466586:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951705.466594:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951705.466601:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951705.466608:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951705.466614:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951705.466625:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783951705.466630:0:13040:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783951705.466655:0:13040:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783951705.466660:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783951705.466666:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951705.466671:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783951705.466677:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8e8d7f853380) has no exports 00000020:00080000:1.0:1783951705.466708:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8e8d7f853380) has no exports 00000020:01000000:1.0:1783951705.468375:0:13040:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8d60bf9180 - data ffff8e8d7feab948/ffff8e8d79dbe000 00000020:01000000:1.0:1783951705.468508:0:13040:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8d5dd09480 - data ffff8e8d47a78a20/ffff8e8d74d7d400 00010000:00010000:2.0:1783951705.469017:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951705.469027:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951705.469041:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d60d5ea00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951705.469046:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951705.469057:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951705.469066:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951705.469073:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783951705.469091:0:8310:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1783951705.469095:0:8310:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1783951705.469115:0:8310:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8d50297000 00010000:00010000:2.0:1783951705.469119:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951705.469126:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5ea00/0x443dabd358eec3ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec3b4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951705.469138:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951705.469142:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951705.469148:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d74ff9e00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951705.469150:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951705.469157:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951705.469164:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951705.469169:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783951705.469171:0:8310:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783951705.469174:0:8310:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783951705.469179:0:8310:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8d50297000 00010000:00010000:2.0:1783951705.469182:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951705.469188:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d74ff9e00/0x443dabd358eec5d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec5dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951705.469203:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951705.469204:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951705.469206:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951705.469279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951705.469285:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783951705.469289:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e8d50297000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951705.469296:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 412 00000100:00080000:3.0:1783951705.469302:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.106@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783951705.469307:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.106@tcp: import ffff8e8d50297000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783951705.469343:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d81339c00 x1870608624340864/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951705.469426:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951705.469444:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624340992:0@lo:400:kworker.0 00000400:00000100:3.0:1783951705.469498:0:3315:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870608624340992 offset 0 length 224: 4 00010000:00010000:0.0:1783951705.469629:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951705.483665:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3311:1870608624340864:0@lo:250:kworker.0 00000400:00000100:1.0:1783951705.483886:0:3311:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870608624340864 offset 0 length 520: 4 00100000:10000000:3.0:1783951705.499316:0:13040:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783951705.535352:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec1bc 00000020:00000080:1.0:1783951705.535372:0:13040:0:(genops.c:906:class_export_put()) final put ffff8e8d80e91000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783951705.535399:0:13040:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8d604cd800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783951705.535403:0:13040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d604cd800 2 00000020:01000004:1.0:1783951705.535406:0:13040:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8d604cd800 from lustre-OST0000 00000020:00000080:1.0:1783951705.535432:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951705.535444:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783951705.535448:0:13040:0:(genops.c:906:class_export_put()) final put ffff8e8d7a085800/lustre-OST0000_UUID 00000020:00000080:1.0:1783951705.535461:0:13040:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7a085800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783951705.535469:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783951705.535542:0:13040:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783951705.535548:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783951705.535552:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951705.535557:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783951705.535564:0:13040:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e8d80e95000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783951705.535570:0:13040:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8e8d6053b380) has exports, disconnecting them 00000020:00080000:1.0:1783951705.535575:0:13040:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e8d80e95000), last request at 1783951489 00000020:00000080:1.0:1783951705.535579:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec1e6 00000020:00080000:1.0:1783951705.535589:0:13040:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8d80e95000): rc 0 00000020:00000080:1.0:1783951705.535593:0:13040:0:(genops.c:906:class_export_put()) final put ffff8e8d80e95000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783951705.536048:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d80e91000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783951705.536056:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d80e95000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783951705.542265:0:13040:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783951705.542281:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951705.542285:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783951705.542293:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783951705.542461:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951705.542470:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1783951705.542476:0:13040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d604cd800 1 00000020:00000080:0.0:1783951705.542484:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec176 00000020:00000080:0.0:1783951705.542493:0:13040:0:(genops.c:906:class_export_put()) final put ffff8e8d56296800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1783951705.542499:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1783951705.542507:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951705.542511:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783951705.542514:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8e8d605399c0) has no exports 00000020:00000080:2.0:1783951705.542726:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d7faaf800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783951705.542734:0:36:0:(genops.c:906:class_export_put()) final put ffff8e8d7faa9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783951705.542737:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7faa9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783951705.542747:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783951705.542803:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d56296800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783951705.574936:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951705.574958:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1783951705.574964:0:13040:0:(genops.c:906:class_export_put()) final put ffff8e8d604cf000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1783951705.574986:0:13040:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d604cf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1783951705.575002:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1783951705.575164:0:13040:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e8d604c9800 00000020:02000400:0.0:1783951705.575221:0:13040:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783951706.358528:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951707.387405:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783951708.316000:0:13192:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783951708.323193:0:13192:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1783951708.323280:0:13192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951708.323295:0:13192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951708.323303:0:13192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951708.323310:0:13192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951708.323337:0:13192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783951708.323343:0:13192:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783951708.323365:0:13192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951708.323378:0:13192:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8d81338e00 x1870608624340096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951708.323417:0:13192:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8d81338a80 x1870608624340608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951715 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951708.323435:0:13192:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8d811a4000 x1870608624340736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951716 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951708.323444:0:13192:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8d8133bb80 x1870608624340992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951708.323457:0:13192:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783951708.323462:0:13192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783951708.323495:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624340736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951708.323503:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624340608:0@lo:400:kworker.0 00000100:00100000:0.0:1783951708.323540:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624340992:0@lo:400:kworker.0 00000100:00100000:1.0:1783951708.323571:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1870608624340096:0@lo:400:kworker.0 00000100:00080000:2.0:1783951708.323614:0:13192:0:(import.c:65:import_set_state_nolock()) ffff8e8d757be800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783951708.323650:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783951708.323658:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1870608624341120:0@lo:39:umount.0 00010000:00010000:3.0:1783951708.323659:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951708.323678:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41512000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951708.323681:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951708.323691:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951708.323698:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951708.323704:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951708.323707:0:8310:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783951708.323709:0:8310:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000400:00000100:1.0:1783951708.323716:0:3311:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870608624341120 offset 0 length 224: 4 00010000:00010000:3.0:1783951708.323726:0:8310:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8d50297000 00010000:00010000:3.0:1783951708.323730:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951708.323737:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d41512000/0x443dabd358eec383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec38a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951708.323748:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951708.323757:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951708.323759:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951708.405975:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951709.430515:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951710.455589:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951710.582020:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951710.582031:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783951711.478117:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951712.504923:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951713.528657:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951714.552749:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951715.574086:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951715.701955:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951715.701964:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1783951716.598423:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951717.622270:0:8311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951718.520260:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951708/real 1783951708] req@ffff8e8d757a5880 x1870608624341120/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951718 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951718.520344:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8d757a5880 x1870608624341120/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951718 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951718.520378:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d757be800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783951718.520399:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1870608624341120:0@lo:39:umount.0 00000100:00080000:2.0:1783951718.520682:0:13192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951718.520696:0:13192:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783951718.520702:0:13192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783951718.521913:0:13192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951718.521933:0:13192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951718.521940:0:13192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951718.521947:0:13192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951718.521976:0:13192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951718.521984:0:13192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951718.522010:0:13192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951718.522016:0:13192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951718.522023:0:13192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951718.522046:0:13192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783951718.522051:0:13192:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783951718.522079:0:13192:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783951718.522083:0:13192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783951718.522088:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951718.522094:0:13192:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783951718.522099:0:13192:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8e8d7f8519c0) has no exports 00010000:00010000:3.0:1783951718.522112:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951718.522122:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783951718.522129:0:13192:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8e8d7f8519c0) has no exports 00010000:00010000:3.0:1783951718.522131:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d41513600 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951718.522134:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951718.522145:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951718.522152:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951718.522159:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951718.522161:0:8310:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1783951718.522163:0:8310:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1783951718.522180:0:8310:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8d50297000 00010000:00010000:3.0:1783951718.522184:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951718.522190:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d41513600/0x443dabd358eec391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec398 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951718.522219:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951718.522222:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951718.522228:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d4165e000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951718.522231:0:8310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951718.522237:0:8310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951718.522244:0:8310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951718.522249:0:8310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783951718.522251:0:8310:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783951718.522252:0:8310:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783951718.522256:0:8310:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8d50297000 00010000:00010000:3.0:1783951718.522259:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951718.522265:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d4165e000/0x443dabd358eec5c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec5cf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951718.522277:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951718.522279:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951718.522336:0:8310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951718.525671:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783951718.532783:0:13192:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8d812181e0 - data ffff8e8d7fe90000/ffff8e8d76e34000 00000020:01000000:2.0:1783951718.532912:0:13192:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8d79ef8000 - data ffff8e8d47bf6288/ffff8e8d76ec8000 00100000:10000000:2.0:1783951718.545044:0:13192:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783951718.606465:0:13192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec287 00000020:00000080:3.0:1783951718.606480:0:13192:0:(genops.c:906:class_export_put()) final put ffff8e8d76e9a800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783951718.606529:0:13192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8d7a084000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783951718.606533:0:13192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d7a084000 2 00000020:01000004:3.0:1783951718.606536:0:13192:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8d7a084000 from lustre-OST0001 00000020:00000080:3.0:1783951718.606561:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951718.606571:0:13192:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783951718.606575:0:13192:0:(genops.c:906:class_export_put()) final put ffff8e8d76e99800/lustre-OST0001_UUID 00000020:00000080:3.0:1783951718.606578:0:13192:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d76e99800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783951718.606584:0:13192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1783951718.606664:0:13192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8da93b96-3ed4-473a-afe6-6e7d7d0f924f->MGS 00010000:00010000:3.0:1783951718.606680:0:13192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec1a0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951718.606692:0:13192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec1a0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951718.606698:0:13192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783951718.606701:0:13192:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783951718.606705:0:13192:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783951718.606720:0:13192:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8d50297000 00010000:00010000:3.0:1783951718.606724:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d60d5f000/0x443dabd358eec199 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec1a0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951718.606739:0:13192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x443dabd358eec3de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951718.606746:0:13192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x443dabd358eec3de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951718.606751:0:13192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951718.606754:0:13192:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783951718.606756:0:13192:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783951718.606764:0:13192:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8d50297000 00010000:00010000:3.0:1783951718.606774:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5200/0x443dabd358eec3d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x443dabd358eec3de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783951718.606792:0:13192:0:(import.c:65:import_set_state_nolock()) ffff8e8d50297000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783951718.606796:0:13192:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783951718.606798:0:13192:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783951718.606800:0:13192:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783951718.606803:0:13192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783951718.607007:0:13192:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8d81339c00 x1870608624340864/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783951720 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783951718.607076:0:13192:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783951718.607080:0:13192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:0.0:1783951718.607146:0:477:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d76e9a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1783951718.618283:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8da93b96-3ed4-473a-afe6-6e7d7d0f924f:3311:1870608624340864:0@lo:250:kworker.0 10000000:01000000:3.0:1783951718.619770:0:13192:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783951718.619787:0:13192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec07a 00000020:00000080:3.0:1783951718.619797:0:13192:0:(genops.c:906:class_export_put()) final put ffff8e8d50294000/8da93b96-3ed4-473a-afe6-6e7d7d0f924f 00000020:01000000:3.0:1783951718.619915:0:13192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.106@tcp (flags='') 00000020:00000080:3.0:1783951718.619928:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951718.619936:0:13192:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951718.619941:0:13192:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8e8d585e0000) has no exports 10000000:01000000:3.0:1783951718.619970:0:5788:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1783951718.620063:0:13192:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.106@tcp: client import never connected 00000100:00080000:3.0:1783951718.620067:0:13192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1783951718.620069:0:13192:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783951718.620072:0:13192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783951718.620074:0:13192:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783951718.620133:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951718.620141:0:13192:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.106@tcp (uuid 8da93b96-3ed4-473a-afe6-6e7d7d0f924f) 00000020:01000000:3.0:1783951718.620148:0:13192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783951718.620151:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951718.620156:0:13192:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783951718.620165:0:13192:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e8d757bc000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951718.620170:0:13192:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8e8d60538000) has exports, disconnecting them 00000020:00080000:3.0:1783951718.620197:0:13192:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e8d757bc000), last request at 1783951507 00000020:00000080:3.0:1783951718.620201:0:13192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec2b1 00000020:00080000:3.0:1783951718.620213:0:13192:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8d757bc000): rc 0 00000020:00000080:3.0:1783951718.620217:0:13192:0:(genops.c:906:class_export_put()) final put ffff8e8d757bc000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783951718.620346:0:477:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d50294000/8da93b96-3ed4-473a-afe6-6e7d7d0f924f for MGC192.168.201.106@tcp 00000020:00000080:0.0:1783951718.621197:0:477:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d757bc000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1783951718.627930:0:13192:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783951718.627942:0:13192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951718.627947:0:13192:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783951718.627956:0:13192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783951718.628009:0:477:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d757be800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783951718.628168:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951718.628177:0:13192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1783951718.628183:0:13192:0:(genops.c:906:class_export_put()) final put ffff8e8d7f757000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1783951718.628187:0:13192:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7f757000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1783951718.628193:0:13192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1783951718.628255:0:13192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d7a084000 1 00000020:00000080:0.0:1783951718.628275:0:13192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x443dabd358eec256 00000020:00000080:0.0:1783951718.628283:0:13192:0:(genops.c:906:class_export_put()) final put ffff8e8d60a1b000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1783951718.628292:0:13192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1783951718.628301:0:477:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d60a1b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783951718.628310:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951718.628315:0:13192:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951718.628319:0:13192:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8e8d81664d40) has no exports 00000020:00000080:0.0:1783951718.629615:0:477:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8d50297000 for MGC192.168.201.106@tcp 00000020:00000080:0.0:1783951718.629626:0:477:0:(genops.c:906:class_export_put()) final put ffff8e8d50292800/8da93b96-3ed4-473a-afe6-6e7d7d0f924f 00000020:00000080:0.0:1783951718.629629:0:477:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d50292800/8da93b96-3ed4-473a-afe6-6e7d7d0f924f for MGC192.168.201.106@tcp 00000020:01000000:0.0:1783951718.629636:0:477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.106@tcp (8da93b96-3ed4-473a-afe6-6e7d7d0f924f) 00010000:00010000:1.0:1783951718.630193:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1783951718.631100:0:8311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1783951718.631730:0:8310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1783951718.634576:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1783951718.634797:0:5774:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e8d60b25200:5774] 0 exiting: rc = 1 00000100:00100000:1.0:1783951718.634897:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e8d60b24600:5775] 1 exiting: rc = 0 00000100:00100000:0.0:1783951718.635017:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.635673:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e8d5614ea00:5777] 1 exiting: rc = 0 00000100:00100000:2.0:1783951718.635864:0:5778:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e8d60b24e00:5778] 2 exiting: rc = 0 00000100:00100000:1.0:1783951718.637272:0:8312:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e8d50542800:8312] 3 exiting: rc = 0 00000100:00100000:0.0:1783951718.639513:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e8d60b24800:5776] 0 exiting: rc = 1 00000100:00100000:0.0:1783951718.639651:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639660:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639665:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639672:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639678:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639684:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639690:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639696:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639702:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639708:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639713:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639718:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639724:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639729:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639737:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639743:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639749:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639755:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639760:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639785:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639791:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639798:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639805:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639829:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639838:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639844:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639850:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639856:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639862:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639867:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639872:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639878:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639883:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639888:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639893:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639897:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639902:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639907:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639912:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639920:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639925:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639930:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639935:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639940:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639945:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639951:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639956:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639962:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.639993:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640000:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640006:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640011:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640017:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640023:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640036:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640042:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640047:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640052:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640057:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640063:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640069:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640074:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640079:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.640084:0:477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783951718.687682:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951718.687703:0:13192:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1783951718.687710:0:13192:0:(genops.c:906:class_export_put()) final put ffff8e8d7a083800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1783951718.687716:0:13192:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d7a083800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1783951718.687725:0:13192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783951718.687976:0:13192:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e8d7a083000 00000020:01000000:1.0:1783951718.688009:0:13192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783951718.688013:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951718.688018:0:13192:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783951718.688022:0:13192:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8e8d6053cd40) has no exports 00000020:00000080:1.0:1783951718.688051:0:13192:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951718.688059:0:13192:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783951718.688062:0:13192:0:(genops.c:906:class_export_put()) final put ffff8e8d8160c000/OSS_uuid 00000020:00000080:1.0:1783951718.688065:0:13192:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8d8160c000/OSS_uuid for OSS 00000020:01000000:1.0:1783951718.688080:0:13192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1783951718.688195:0:5787:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783951718.688489:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8e8d65cf6600:6589] 0 exiting: rc = 1 00000100:00100000:1.0:1783951718.689926:0:8067:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8e8d60532a00:8067] 3 exiting: rc = 0 00000100:00100000:1.0:1783951718.690016:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8e8d6da4bc00:6590] 1 exiting: rc = 0 00000100:00100000:0.0:1783951718.693958:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8e8d74ea2a00:6591] 2 exiting: rc = 0 00000100:00100000:1.0:1783951718.694432:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694440:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694448:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694454:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694460:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694466:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694472:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694477:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694495:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694503:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694508:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694513:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694519:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694524:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694530:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694535:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694541:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694546:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694551:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694558:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694564:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694569:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694574:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694580:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694589:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694595:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694600:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694605:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694611:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694618:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694643:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694648:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694654:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694660:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694665:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694670:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694676:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694681:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694687:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694692:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694709:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694717:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694722:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694728:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694733:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694738:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694743:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694748:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694752:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694758:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694763:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694768:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694774:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694780:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694784:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694791:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694796:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694802:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694829:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694836:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694842:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694847:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694852:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.694857:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.695704:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e8d79b8f200:6593] 0 exiting: rc = 1 00000100:00100000:2.0:1783951718.698183:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e8d74ea3a00:6594] 1 exiting: rc = 0 00000100:00100000:1.0:1783951718.703154:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703172:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703180:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703187:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703196:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703389:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703399:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703405:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703410:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703415:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703420:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703425:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703446:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703539:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703547:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703553:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703558:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703564:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703571:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703577:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703584:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703593:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703603:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703609:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703616:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703621:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703625:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703630:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703635:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703645:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703661:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703670:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703674:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703679:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703684:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703702:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703708:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703713:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703719:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703729:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703735:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703741:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703747:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703753:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703759:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703765:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703771:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703776:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703782:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703787:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703792:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703803:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703956:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703965:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703973:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703992:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.703999:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.704009:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.704015:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.704021:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.704026:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.704030:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.704036:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951718.704043:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.710087:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e8d74ea3200:6597] 2 exiting: rc = 0 00000100:00100000:3.0:1783951718.712591:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e8d74ea3c00:6596] 1 exiting: rc = 0 00000100:00100000:3.0:1783951718.713697:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e8d605d3000:6595] 0 exiting: rc = 1 00000100:00100000:0.0:1783951718.713867:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713876:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713882:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713888:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713894:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713900:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713906:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713911:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713918:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713923:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713929:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713936:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713942:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713949:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713955:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713961:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.713967:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714336:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714349:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714356:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714630:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714638:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714644:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714661:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714667:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714672:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714677:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714682:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714688:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714693:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714700:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714706:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714712:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714718:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714723:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714728:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714735:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714742:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714748:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714753:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714759:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714765:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714772:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714778:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714800:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714839:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714847:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714853:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714859:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714864:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714870:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714876:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714881:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714887:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714894:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714899:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714905:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714910:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714922:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714927:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714933:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714938:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714944:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.714949:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.722556:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e8d74eaf600:6599] 1 exiting: rc = 0 00000100:00100000:3.0:1783951718.726088:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e8d74ea3600:6598] 0 exiting: rc = 1 00000100:00100000:0.0:1783951718.730215:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730228:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730233:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730238:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730244:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730249:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730255:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730260:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730266:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730271:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730277:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730283:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730288:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730294:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730300:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730307:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730312:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730316:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730323:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730328:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730334:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730340:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730347:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730353:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730360:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730365:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730551:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730560:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730589:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730594:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730601:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730608:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730613:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730617:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730624:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730629:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730634:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730639:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730645:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730650:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730655:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730660:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730666:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730671:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730676:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730681:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730685:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730690:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730696:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730702:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730708:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730714:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730719:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730724:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730730:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730735:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730741:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730747:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730752:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730757:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730763:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730768:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730844:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.730858:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.735746:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e8d605d3800:6601] 1 exiting: rc = 0 00000100:00100000:1.0:1783951718.735896:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e8d605d2a00:6600] 0 exiting: rc = 1 00000100:00100000:0.0:1783951718.736127:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736147:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736154:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736160:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736167:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736174:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736180:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736187:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736194:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736213:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736230:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736237:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736247:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736255:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736263:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736271:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736276:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736290:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736299:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736306:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736312:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736338:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736346:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736352:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736359:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736366:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736373:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736379:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736387:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736393:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736399:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736405:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736411:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736445:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736451:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736458:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736464:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736471:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736477:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736684:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736698:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736705:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736712:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736720:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736727:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736748:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736755:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736761:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736768:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736774:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736780:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736788:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736794:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736801:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736807:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736844:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736852:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736872:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736880:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736887:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736895:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736904:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736913:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951718.736928:0:13192:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783951718.763902:0:13192:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1783951734.950972:0:13810:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783951742.391357:0:14226:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783951742.391362:0:14226:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1783951742.391722:0:14226:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8c43562000 00000020:01000004:0.0:1783951742.391751:0:14226:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783951742.391760:0:14226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783951742.391777:0:14226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e8d81663380) 00000020:00000080:0.0:1783951742.391792:0:14226:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783951742.414644:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783951742.417168:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1783951742.417675:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1783951742.417774:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1783951742.418268:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1783951742.418448:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1783951742.419220:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1783951742.419412:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1783951742.419522:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1783951742.419738:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1783951742.420723:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 459: rc = 0 00100000:10000000:1.0:1783951742.420834:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 459: rc = 0 00100000:10000000:1.0:1783951742.421333:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:1.0:1783951742.421675:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 772: rc = 0 00100000:10000000:1.0:1783951742.421935:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:1.0:1783951742.422321:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 772: rc = 0 00100000:10000000:1.0:1783951742.422790:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 772: rc = 0 00100000:10000000:1.0:1783951742.423324:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00100000:10000000:1.0:1783951742.424061:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:1.0:1783951742.424310:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 772: rc = 0 00100000:10000000:1.0:1783951742.424712:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 772: rc = 0 00100000:10000000:1.0:1783951742.425057:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:1.0:1783951742.425378:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 772: rc = 0 00100000:10000000:1.0:1783951742.425708:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:1.0:1783951742.426399:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 786: rc = 0 00100000:10000000:1.0:1783951742.426724:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 786: rc = 0 00100000:10000000:1.0:1783951742.427146:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 786: rc = 0 00100000:10000000:1.0:1783951742.427390:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 786: rc = 0 00100000:10000000:1.0:1783951742.427721:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 786: rc = 0 00100000:10000000:1.0:1783951742.428006:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 786: rc = 0 00100000:10000000:1.0:1783951742.428705:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 786: rc = 0 00100000:10000000:1.0:1783951742.429244:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 786: rc = 0 00100000:10000000:1.0:1783951742.429550:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 786: rc = 0 00100000:10000000:1.0:1783951742.429846:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 786: rc = 0 00100000:10000000:1.0:1783951742.430172:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 786: rc = 0 00100000:10000000:1.0:1783951742.430409:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 786: rc = 0 00100000:10000000:1.0:1783951742.430733:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 786: rc = 0 00100000:10000000:1.0:1783951742.431156:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 786: rc = 0 00100000:10000000:1.0:1783951742.431414:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 786: rc = 0 00100000:10000000:1.0:1783951742.431731:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 786: rc = 0 00100000:10000000:1.0:1783951742.432004:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 786: rc = 0 00100000:10000000:1.0:1783951742.432325:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 786: rc = 0 00100000:10000000:1.0:1783951742.432699:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 786: rc = 0 00100000:10000000:1.0:1783951742.433039:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 786: rc = 0 00100000:10000000:1.0:1783951742.433351:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 786: rc = 0 00100000:10000000:1.0:1783951742.433719:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 786: rc = 0 00100000:10000000:1.0:1783951742.434371:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 786: rc = 0 00100000:10000000:1.0:1783951742.434759:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 786: rc = 0 00100000:10000000:1.0:1783951742.435339:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 786: rc = 0 00100000:10000000:1.0:1783951742.435625:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 786: rc = 0 00100000:10000000:1.0:1783951742.435914:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 786: rc = 0 00100000:10000000:1.0:1783951742.436104:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 786: rc = 0 00100000:10000000:1.0:1783951742.436301:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 786: rc = 0 00100000:10000000:1.0:1783951742.436518:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 786: rc = 0 00100000:10000000:1.0:1783951742.436779:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 786: rc = 0 00100000:10000000:1.0:1783951742.436997:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 786: rc = 0 00100000:10000000:1.0:1783951742.437278:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 540: rc = 0 00100000:10000000:1.0:1783951742.437755:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1783951742.437913:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 460: rc = 0 00100000:10000000:1.0:1783951742.438065:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1783951742.438123:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 460: rc = 0 00100000:10000000:1.0:1783951742.438267:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1783951742.438333:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 460: rc = 0 00100000:10000000:1.0:1783951742.440528:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1783951742.440652:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 536: rc = 0 00100000:10000000:1.0:1783951742.441092:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1783951742.441167:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 536: rc = 0 00100000:10000000:1.0:1783951742.441358:0:14226:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1783951742.441424:0:14226:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 536: rc = 0 00000020:00000080:1.0:1783951742.442092:0:14226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783951742.442100:0:14226:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783951742.442111:0:14226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eed37b 00000020:01000004:1.0:1783951742.442119:0:14226:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1783951742.442123:0:14226:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783951742.442129:0:14226:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8c43562000 from MGS 00000020:01000004:1.0:1783951742.442132:0:14226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783951742.442141:0:14226:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e8d65ab0000) 00000020:00000080:1.0:1783951742.442148:0:14226:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1783951742.442194:0:14226:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8c43562000 from MGS, refs=2 00080000:01000000:1.0:1783951742.442197:0:14226:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783951742.442200:0:14226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eed389 00000100:00100000:1.0:1783951742.442270:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1783951742.442376:0:14226:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1783951742.442380:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1783951742.442929:0:14226:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1783951742.442934:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1783951742.443399:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783951742.443496:0:14226:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1783951742.443500:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1783951742.444005:0:14226:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1783951742.444013:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1783951742.445007:0:14226:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1783951742.445015:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783951742.445961:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951742.445965:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951742.445967:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951742.446192:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951742.446194:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951742.446196:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951742.448385:0:14226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783951742.450092:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1783951742.460570:0:14226:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1783951742.460599:0:14226:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783951742.460602:0:14226:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783951742.462797:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783951742.465522:0:14226:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783951742.465647:0:14226:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783951742.467770:0:14226:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783951742.470199:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951742.470785:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783951742.470793:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783951742.473987:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783951742.473999:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783951742.474242:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783951742.474246:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783951742.474832:0:14226:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783951742.474850:0:14226:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.106@tcp' 00000020:01000004:3.0:1783951742.474852:0:14226:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783951742.474880:0:14226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.106@tcp (typ=mgc) 00000020:00000080:3.0:1783951742.474891:0:14226:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.106@tcp (ffff8e8d7f8519c0) 00000020:00000080:3.0:1783951742.474902:0:14226:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783951742.474962:0:14226:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d81323800@MGC192.168.201.106@tcp: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783951742.475084:0:14226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.106@tcp-0 is initialized 00000040:01000000:3.0:1783951742.475091:0:14226:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783951742.475314:0:14240:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1783951742.478064:0:14242:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783951742.478147:0:14226:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.106@tcp (uuid a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8) 00000020:00000080:3.0:1783951742.478175:0:14226:0:(genops.c:1406:class_connect()) connect: client a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8, cookie 0x443dabd358eed397 00000100:00080000:3.0:1783951742.478187:0:14226:0:(import.c:510:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951742.478201:0:14226:0:(import.c:624:import_select_connection()) MGC192.168.201.106@tcp: import ffff8e8d81323800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1783951742.478236:0:14226:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d8133a300 x1870608624341248/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951742.478305:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3311:1870608624341248:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783951742.478376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783951742.478442:0:14226:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8->MGS 00000020:01000004:3.0:1783951742.478462:0:14226:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783951742.478486:0:14226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783951742.478500:0:14226:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e8d7f854d40) 00000020:00000080:3.0:1783951742.478512:0:14226:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1783951742.487626:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624341248 00000100:00100000:0.0:1783951742.487639:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624341248 00000100:00100000:0.0:1783951742.487689:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951742.487697:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1870608624341248:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783951742.487727:0:14237:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1783951742.487760:0:14237:0:(genops.c:1406:class_connect()) connect: client a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8, cookie 0x443dabd358eed3a5 00000100:00080000:0.0:1783951742.487907:0:14237:0:(import.c:65:import_set_state_nolock()) ffff8e8c43565000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951742.488008:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+5:3311:x1870608624341248:12345-0@lo:250:mount.lustre.0 Request processed in 310us (9631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951742.488016:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951742.488064:0:3311:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1783951742.488074:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1783951742.488082:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783951742.488094:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783951742.488098:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d81323800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783951742.488100:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783951742.488109:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783951742.488115:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3311:1870608624341248:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783951742.493133:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951742.493453:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783951742.493460:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783951742.497470:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783951742.497482:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783951742.499727:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783951742.499741:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783951742.500502:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951742.500674:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783951742.500681:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783951742.501227:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783951742.501234:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783951742.531540:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951742.531754:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783951742.531760:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783951742.533198:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783951742.533210:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783951742.533783:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951742.534129:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783951742.534140:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783951742.534755:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783951742.534763:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783951742.535342:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951742.535479:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783951742.535485:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783951742.535943:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783951742.535950:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783951742.536511:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951742.536650:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783951742.536655:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783951742.537208:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783951742.537214:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783951742.565784:0:14226:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951742.571008:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783951742.571018:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783951742.576874:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783951742.576894:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783951742.578025:0:14226:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783951742.578034:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783951742.579441:0:14226:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783951742.579482:0:14226:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1783951742.579490:0:14226:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783951742.579655:0:14226:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783951742.579693:0:14226:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783951742.579698:0:14226:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783951742.579699:0:14226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951742.579701:0:14226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951742.579702:0:14226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951742.579703:0:14226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951742.579704:0:14226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951742.579705:0:14226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951742.579707:0:14226:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951742.579709:0:14226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951742.579710:0:14226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951742.579713:0:14226:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783951742.579715:0:14226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951742.579716:0:14226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951742.579718:0:14226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951742.579719:0:14226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951742.579720:0:14226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951742.579721:0:14226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951742.579722:0:14226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951742.579724:0:14226:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951742.579730:0:14226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951742.579731:0:14226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951742.579759:0:14226:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783951742.579779:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951742.579901:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951742.579954:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8145ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951742.580106:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624341376 00000100:00100000:0.0:1783951742.580113:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624341376 00000100:00100000:0.0:1783951742.580156:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951742.580165:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+5:14226:x1870608624341376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783951742.580208:0:14239:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783951742.580211:0:14239:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783951742.580214:0:14239:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1783951742.580737:0:14260:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783951742.581243:0:14239:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1783951742.582636:0:14261:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783951742.582642:0:14261:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783951742.582645:0:14261:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783951742.582682:0:14261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1783951742.583267:0:14239:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783951742.583340:0:14239:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783951742.589587:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+5:14226:x1870608624341376:12345-0@lo:253:mount.lustre.0 Request processed in 9403us (9666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951742.589609:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951742.589708:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341376:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951742.589726:0:14226:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783951742.589730:0:14226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951742.589732:0:14226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951742.589733:0:14226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951742.589734:0:14226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951742.589735:0:14226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951742.589737:0:14226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951742.589738:0:14226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951742.589740:0:14226:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951742.589742:0:14226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951742.589743:0:14226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783951742.589783:0:14226:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8c43562000 from lustre-MDT0000 10000000:01000000:0.0:1783951742.589989:0:14226:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783951742.589993:0:14226:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783951742.589997:0:14226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e8d7f8519c0 10000000:01000000:0.0:1783951742.590002:0:14226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951742.590011:0:14226:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8d7f8519c0 from 1 10000000:01000000:0.0:1783951742.590015:0:14226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783951742.590065:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.590222:0:14226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.590234:0:14226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.590256:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341504:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951742.590377:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.590456:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951742.590566:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624341504 00000100:00100000:1.0:1783951742.590572:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624341504 00000100:00100000:1.0:1783951742.590655:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951742.590664:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+5:14226:x1870608624341504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951742.590679:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951742.590694:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e28800/0x443dabd358eed3b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed3ac expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.590717:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e28800/0x443dabd358eed3b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed3ac expref: 6 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.590728:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e28800/0x443dabd358eed3b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed3ac expref: 6 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.590738:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28800, rc 0) 00000100:00100000:1.0:1783951742.590780:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+6:14226:x1870608624341504:12345-0@lo:101:mount.lustre.0 Request processed in 117us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951742.590787:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951742.590886:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341504:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951742.590900:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.590909:0:14226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.590951:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951742.590975:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.591239:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951742.591287:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624341632 00000100:00100000:2.0:1783951742.591293:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624341632 00000100:00100000:2.0:1783951742.591317:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951742.591324:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+6:14226:x1870608624341632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951742.591684:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+6:14226:x1870608624341632:12345-0@lo:501:mount.lustre.0 Request processed in 360us (707us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951742.591691:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783951742.591839:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341632:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783951742.591865:0:14226:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783951742.591882:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.591891:0:14226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951742.591899:0:14226:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8c43562000 10000000:01000000:0.0:1783951742.591904:0:14226:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783951742.591908:0:14226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e8c43562000 10000000:01000000:0.0:1783951742.591910:0:14226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783951742.591913:0:14226:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8e8c43562000 from 1 10000000:01000000:0.0:1783951742.591915:0:14226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783951742.591935:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4000/0x443dabd358eed3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.591943:0:14226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4000/0x443dabd358eed3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.591952:0:14226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4000/0x443dabd358eed3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.591965:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951742.591992:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.592017:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951742.592244:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624341760 00000100:00100000:3.0:1783951742.592249:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624341760 00000100:00100000:3.0:1783951742.592347:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951742.592356:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+6:14226:x1870608624341760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951742.592366:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951742.592378:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d76dfd600/0x443dabd358eed3c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed3ba expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.592397:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d76dfd600/0x443dabd358eed3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed3ba expref: 7 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.592407:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d76dfd600/0x443dabd358eed3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed3ba expref: 7 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.592427:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfd600, rc 0) 00000100:00100000:3.0:1783951742.592458:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+7:14226:x1870608624341760:12345-0@lo:101:mount.lustre.0 Request processed in 103us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951742.592582:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951742.592668:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951742.592682:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4000/0x443dabd358eed3ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3c1 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.592708:0:14226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4000/0x443dabd358eed3ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed3c1 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951742.592722:0:14226:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783951742.592764:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4000/0x443dabd358eed3ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3c1 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.592772:0:14226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4000/0x443dabd358eed3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3c1 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951742.592779:0:14226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783951742.592783:0:14226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951742.592787:0:14226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e8c43562000 10000000:01000000:0.0:1783951742.592790:0:14226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783951742.592793:0:14226:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783951742.592795:0:14226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783951742.592831:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eed3c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.592838:0:14226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eed3c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.592845:0:14226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eed3c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.592858:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951742.592885:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.592915:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951742.592982:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624341888 00000100:00100000:1.0:1783951742.592987:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624341888 00000100:00100000:1.0:1783951742.593023:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951742.593030:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+7:14226:x1870608624341888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951742.593037:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951742.593046:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e29400/0x443dabd358eed3cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed3c8 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.593059:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e29400/0x443dabd358eed3cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed3c8 expref: 8 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.593066:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e29400/0x443dabd358eed3cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed3c8 expref: 8 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.593072:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29400, rc 0) 00000100:00100000:1.0:1783951742.593107:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+8:14226:x1870608624341888:12345-0@lo:101:mount.lustre.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951742.593113:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951742.593250:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624341888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951742.593261:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eed3c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3cf expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.593268:0:14226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eed3c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed3cf expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.593320:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624342016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951742.593345:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.593369:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951742.593548:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624342016 00000100:00100000:1.0:1783951742.593552:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624342016 00000100:00100000:1.0:1783951742.593587:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951742.593593:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+8:14226:x1870608624342016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951742.594001:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+9:14226:x1870608624342016:12345-0@lo:501:mount.lustre.0 Request processed in 407us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951742.594008:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783951742.594201:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624342016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951742.594232:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624342144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951742.594268:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.594359:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6036e780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951742.594412:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624342144 00000100:00100000:1.0:1783951742.594417:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624342144 00000100:00100000:1.0:1783951742.594445:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951742.594451:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+9:14226:x1870608624342144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951742.594981:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+9:14226:x1870608624342144:12345-0@lo:503:mount.lustre.0 Request processed in 529us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951742.594988:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951742.595205:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624342144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951742.595776:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14262:1870608624342272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951742.595924:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.595984:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d604e7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951742.596018:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624342272 00000100:00100000:0.0:1783951742.596025:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624342272 00000100:00100000:0.0:1783951742.596162:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951742.596171:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+9:14262:x1870608624342272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951742.596612:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+9:14262:x1870608624342272:12345-0@lo:502:llog_process_th.0 Request processed in 440us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951742.596619:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783951742.596686:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14262:1870608624342272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951742.596712:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951742.596723:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.596726:0:14262:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783951742.596731:0:14262:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783951742.596734:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951742.596755:0:14262:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e8d7c1d99c0) 00000020:00000080:2.0:1783951742.596774:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783951742.596784:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783951742.596887:0:14262:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783951742.596896:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eed3dd 00000020:00000080:2.0:1783951742.597141:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783951742.597146:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951742.597149:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.597151:0:14262:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783951742.597154:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951742.597157:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.597159:0:14262:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783951742.597162:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951742.597169:0:14262:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e8d7c1dcd40) 00000020:00000080:2.0:1783951742.597178:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783951742.597182:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783951742.597185:0:14262:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783951742.597187:0:14262:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783951742.597193:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783951742.597239:0:14262:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8c43562000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783951742.597252:0:14262:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e8d7c1db380) 00000020:00000080:2.0:1783951742.597259:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783951742.597312:0:14262:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783951742.597322:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eed3f2 00000020:00000080:2.0:1783951742.597407:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783951742.597413:0:14262:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783951742.597417:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x443dabd358eed3f9 00080000:01000000:2.0:1783951742.597421:0:14262:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783951742.597425:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eed400 00010000:00010000:2.0:1783951742.653951:0:14262:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783951742.654697:0:14262:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1783951742.654917:0:14262:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783951742.655647:0:14262:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e8d7c1d8000) 00000020:00000080:2.0:1783951742.655674:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783951742.655735:0:14262:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783951742.655743:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eed40e 00000020:00000080:3.0:1783951742.656296:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783951742.660406:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x443dabd358eed415 00000020:00000080:3.0:1783951742.662223:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783951742.662236:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951742.662244:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951742.662246:0:14262:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783951742.662249:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951742.662255:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951742.662256:0:14262:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783951742.662260:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783951742.662314:0:14262:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783951742.662335:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951742.662339:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951742.662340:0:14262:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783951742.662342:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783951742.662344:0:14262:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783951742.662346:0:14262:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951742.662348:0:14262:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951742.662349:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783951742.662351:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951742.662352:0:14262:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783951742.662355:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951742.662358:0:14262:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783951742.662361:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951742.662362:0:14262:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783951742.662365:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783951742.662376:0:14262:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1783951742.662403:0:14262:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783951742.662406:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951742.662422:0:14262:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e8d7f853380) 00000020:00000080:3.0:1783951742.662440:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783951742.662445:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783951742.662679:0:14262:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783951742.662686:0:14262:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783951742.662693:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eed423 00010000:00080000:3.0:1783951742.662749:0:14262:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d601c1800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1783951742.662986:0:14262:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1783951742.666351:0:14262:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783951742.666415:0:14262:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783951742.668925:0:14262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951742.668998:0:14262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783951742.669179:0:14262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1783951742.671870:0:14266:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783951742.671877:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783951742.676237:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951742.676259:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783951742.676307:0:14262:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783951742.676331:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eed42a 00000100:00080000:2.0:1783951742.676342:0:14262:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951742.676348:0:14262:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8d601c1800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951742.676387:0:14262:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d757a5f80 x1870608624342400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951742.676457:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624342400:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783951742.676547:0:3311:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870608624342400 offset 0 length 520: 4 00000100:00080000:2.0:1783951742.677031:0:14262:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783951742.677150:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951742.677156:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.677158:0:14262:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783951742.677162:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951742.677164:0:14262:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1783951742.677166:0:14262:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951742.677168:0:14262:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951742.677169:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951742.677171:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.677173:0:14262:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951742.677175:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783951742.677180:0:14262:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783951742.677183:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.677185:0:14262:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783951742.677187:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783951742.677192:0:14262:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:2.0:1783951742.677216:0:14262:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783951742.677219:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951742.677233:0:14262:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e8d6053cd40) 00000020:00000080:2.0:1783951742.677248:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783951742.677319:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783951742.677397:0:14262:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783951742.677403:0:14262:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783951742.677409:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x443dabd358eed438 00010000:00080000:2.0:1783951742.677440:0:14262:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d606ae000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1783951742.678115:0:14262:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1783951742.678722:0:14262:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783951742.678747:0:14262:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783951742.683198:0:14262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951742.683356:0:14262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783951742.683439:0:14262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1783951742.684030:0:14268:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783951742.684035:0:14268:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783951742.685061:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951742.685236:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783951742.685335:0:14262:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783951742.685361:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eed43f 00000100:00080000:2.0:1783951742.685373:0:14262:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951742.685379:0:14262:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8d606ae000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951742.685417:0:14262:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d757a7800 x1870608624342528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951742.685445:0:14262:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783951742.685616:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951742.685621:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.685623:0:14262:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783951742.685626:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951742.685630:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.685631:0:14262:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783951742.685634:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783951742.685636:0:14262:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783951742.685638:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951742.685640:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.685641:0:14262:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783951742.685643:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951742.685653:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.685654:0:14262:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783951742.685658:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783951742.685695:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14262:1870608624342656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951742.685783:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.685847:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951742.685924:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624342528:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783951742.685954:0:3311:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870608624342528 offset 0 length 520: 4 00000100:00100000:1.0:1783951742.686054:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624342656 00000100:00100000:1.0:1783951742.686061:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624342656 00000100:00100000:1.0:1783951742.686116:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951742.686126:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+9:14262:x1870608624342656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951742.686649:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+9:14262:x1870608624342656:12345-0@lo:502:llog_process_th.0 Request processed in 522us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951742.686657:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951742.686774:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14262:1870608624342656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951742.686800:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951742.686805:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.686806:0:14262:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783951742.687163:0:14262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1783951742.687363:0:14226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1783951742.687382:0:14226:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783951742.687401:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eed3c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3cf expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.687413:0:14226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4a00/0x443dabd358eed3c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3cf expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951742.687421:0:14226:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e8c43562000 from 1 10000000:01000000:1.0:1783951742.687424:0:14226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951742.687459:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.687468:0:14226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951742.687661:0:14226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951742.687681:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624342784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951742.687743:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951742.688143:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d8145e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951742.688437:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624342784 00000100:00100000:3.0:1783951742.688444:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624342784 00000100:00100000:3.0:1783951742.688492:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783951742.688501:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+9:14226:x1870608624342784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951742.688515:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951742.688680:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed446 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.688709:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed446 expref: 10 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.688730:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed446 expref: 10 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.688739:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfdc00, rc 0) 00000100:00100000:3.0:1783951742.688791:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+10:14226:x1870608624342784:12345-0@lo:101:mount.lustre.0 Request processed in 290us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951742.688798:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951742.688939:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624342784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951742.688967:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.688975:0:14226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.689766:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624342912:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783951742.689912:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.689982:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951742.690165:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624342912 00000100:00100000:2.0:1783951742.690171:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624342912 00000100:00100000:2.0:1783951742.690237:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951742.690247:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+10:14226:x1870608624342912:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783951742.690264:0:14238:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783951742.690329:0:14238:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783951742.690406:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+10:14226:x1870608624342912:12345-0@lo:256:mount.lustre.0 Request processed in 161us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951742.690414:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951742.690484:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624342912:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783951742.691106:0:14226:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783951742.691121:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.691131:0:14226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951742.691139:0:14226:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8c43562000 from 1 10000000:01000000:0.0:1783951742.691142:0:14226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951742.691171:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.691179:0:14226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.691187:0:14226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.691201:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951742.691243:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.691972:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518ac780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951742.692064:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624343040 00000100:00100000:3.0:1783951742.692071:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624343040 00000100:00100000:3.0:1783951742.692112:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951742.692120:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+10:14226:x1870608624343040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951742.692133:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951742.692147:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed454 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.692169:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed454 expref: 11 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.692179:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed454 expref: 11 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.692187:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfc400, rc 0) 00000100:00100000:3.0:1783951742.692232:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14226:x1870608624343040:12345-0@lo:101:mount.lustre.0 Request processed in 113us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951742.692239:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951742.692347:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951742.692362:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.692371:0:14226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.692427:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951742.692453:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.692481:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518ac780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951742.692636:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624343168 00000100:00100000:3.0:1783951742.692641:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624343168 00000100:00100000:3.0:1783951742.692666:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951742.692671:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14226:x1870608624343168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951742.693186:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14226:x1870608624343168:12345-0@lo:501:mount.lustre.0 Request processed in 513us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951742.693194:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783951742.693262:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951742.693292:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951742.693331:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.693398:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951742.693428:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624343296 00000100:00100000:2.0:1783951742.693432:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624343296 00000100:00100000:2.0:1783951742.693611:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951742.693619:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14226:x1870608624343296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951742.693767:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14226:x1870608624343296:12345-0@lo:503:mount.lustre.0 Request processed in 149us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951742.693774:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783951742.693850:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951742.694202:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14270:1870608624343424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951742.694235:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951742.694261:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d76d98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951742.694308:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624343424 00000100:00100000:1.0:1783951742.694313:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624343424 00000100:00100000:1.0:1783951742.694343:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951742.694350:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14270:x1870608624343424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951742.694566:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14270:x1870608624343424:12345-0@lo:502:llog_process_th.0 Request processed in 215us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951742.694581:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951742.694759:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14270:1870608624343424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951742.694788:0:14270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951742.694798:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.694800:0:14270:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783951742.694828:0:14270:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8c43562000 00000020:00000080:2.0:1783951742.694831:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783951742.694842:0:14270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951742.694844:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.694846:0:14270:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783951742.694849:0:14270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951742.694850:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.694852:0:14270:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783951742.694855:0:14270:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8c43562000 00000020:00000080:2.0:1783951742.694857:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783951742.694917:0:14270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951742.694920:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.694921:0:14270:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783951742.694924:0:14270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951742.694926:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.694927:0:14270:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783951742.694931:0:14270:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8c43562000 00000020:00000080:2.0:1783951742.694933:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783951742.694965:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14270:1870608624343552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951742.694999:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.695018:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624343552 00000100:00100000:2.0:1783951742.695023:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624343552 00000100:00100000:2.0:1783951742.695044:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783951742.695050:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14270:x1870608624343552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951742.695166:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14270:x1870608624343552:12345-0@lo:502:llog_process_th.0 Request processed in 115us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951742.695172:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783951742.695206:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951742.695218:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14270:1870608624343552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951742.695235:0:14270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951742.695238:0:14270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951742.695240:0:14270:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783951742.695243:0:14270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783951742.696026:0:14226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783951742.696045:0:14226:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951742.696069:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.696080:0:14226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951742.696126:0:14226:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783951742.696129:0:14226:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8c43562000 10000000:01000000:2.0:1783951742.696131:0:14226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8c43562000 10000000:01000000:2.0:1783951742.696135:0:14226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951742.696140:0:14226:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8c43562000 from 1 10000000:01000000:2.0:1783951742.696142:0:14226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783951742.696169:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d75325a00/0x443dabd358eed462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.696177:0:14226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d75325a00/0x443dabd358eed462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.696187:0:14226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d75325a00/0x443dabd358eed462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951742.696202:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951742.696244:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.696268:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951742.696286:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624343680 00000100:00100000:2.0:1783951742.696290:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624343680 00000100:00100000:2.0:1783951742.696317:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951742.696324:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14226:x1870608624343680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951742.696333:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951742.696346:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d75325e00/0x443dabd358eed469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed462 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.696365:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75325e00/0x443dabd358eed469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed462 expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.696375:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d75325e00/0x443dabd358eed469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed462 expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.696383:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325e00, rc 0) 00000100:00100000:2.0:1783951742.696414:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14226:x1870608624343680:12345-0@lo:101:mount.lustre.0 Request processed in 90us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951742.696420:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951742.696456:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951742.696477:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d75325a00/0x443dabd358eed462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed469 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.696487:0:14226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d75325a00/0x443dabd358eed462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed469 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951742.696688:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951742.696721:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.696742:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951742.696792:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624343808 00000100:00100000:3.0:1783951742.696797:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624343808 00000100:00100000:3.0:1783951742.696849:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783951742.696856:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14226:x1870608624343808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951742.697076:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14226:x1870608624343808:12345-0@lo:501:mount.lustre.0 Request processed in 220us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951742.697083:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951742.698614:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951742.698657:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951742.698704:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.698731:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d603e53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951742.698843:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624343936 00000100:00100000:3.0:1783951742.698848:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624343936 00000100:00100000:3.0:1783951742.698882:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783951742.698890:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14226:x1870608624343936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951742.699042:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14226:x1870608624343936:12345-0@lo:503:mount.lustre.0 Request processed in 152us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951742.699049:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783951742.699977:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624343936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951742.700308:0:14272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14272:1870608624344064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951742.700352:0:14272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.700382:0:14272:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d47cf4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951742.700422:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624344064 00000100:00100000:0.0:1783951742.700427:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624344064 00000100:00100000:0.0:1783951742.700462:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783951742.700479:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14272:x1870608624344064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951742.700891:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14272:x1870608624344064:12345-0@lo:502:llog_process_th.0 Request processed in 420us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951742.700898:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951742.700986:0:14272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14272:1870608624344064:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783951742.701040:0:14272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783951742.701055:0:14272:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e8d60538000) 00000020:00000080:2.0:1783951742.701073:0:14272:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1783951742.701225:0:14272:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8c43562000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951742.701230:0:14272:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8c43562000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951742.701233:0:14272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8c43562000 4 00010000:00080000:2.0:1783951742.701260:0:14272:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d50631000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1783951742.702872:0:14272:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1783951742.702965:0:14272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783951742.702996:0:14272:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951742.703008:0:14272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x443dabd358eed477 00000100:00080000:2.0:1783951742.703018:0:14272:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951742.703022:0:14272:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e8d50631000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951742.703053:0:14272:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d757a4700 x1870608624344192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951742.703088:0:14272:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783951742.703337:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624344192:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951742.703405:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.703728:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624344192 00000100:00100000:2.0:1783951742.703736:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624344192 00000100:00100000:2.0:1783951742.703775:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951742.703782:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870608624344192:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951742.703855:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870608624344192:12345-0@lo:38:llog_process_th.0 Request processed in 72us (450us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783951742.703862:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951742.708725:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951742.708741:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d50631000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951742.708748:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783951742.708753:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624344192:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783951742.712748:0:14272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14272:1870608624344320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951742.712852:0:14272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951742.712902:0:14272:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d505a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951742.713655:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624344320 00000100:00100000:2.0:1783951742.713664:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624344320 00000100:00100000:2.0:1783951742.713708:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951742.713717:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14272:x1870608624344320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951742.713991:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14272:x1870608624344320:12345-0@lo:502:llog_process_th.0 Request processed in 274us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951742.713999:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951742.714223:0:14272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14272:1870608624344320:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783951742.714251:0:14272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783951742.717746:0:14226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783951742.717785:0:14226:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951742.717839:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d75325a00/0x443dabd358eed462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed469 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951742.717853:0:14226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d75325a00/0x443dabd358eed462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed469 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783951742.717906:0:14226:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783951742.717908:0:14226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951742.717910:0:14226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951742.717911:0:14226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951742.717912:0:14226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951742.717914:0:14226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951742.717915:0:14226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951742.717917:0:14226:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951742.717919:0:14226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951742.717920:0:14226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951742.717924:0:14226:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783951742.717926:0:14226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951742.717928:0:14226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951742.717928:0:14226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951742.717930:0:14226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951742.717930:0:14226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951742.717932:0:14226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951742.717932:0:14226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951742.717933:0:14226:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951742.717934:0:14226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951742.717936:0:14226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951742.717964:0:14226:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783951742.717983:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624344448:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783951742.718050:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951742.718087:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518acd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951742.718111:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624344448 00000100:00100000:0.0:1783951742.718117:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624344448 00000100:00100000:0.0:1783951742.718161:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951742.718168:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14226:x1870608624344448:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783951742.718205:0:14238:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783951742.718219:0:14238:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783951742.771388:0:14238:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783951742.771418:0:14238:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783951742.771443:0:14260:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783951742.771448:0:14260:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783951742.771668:0:14260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.771689:0:14260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed446 expref: 12 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.771697:0:14260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.771738:0:14260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eed446 expref: 12 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951742.771752:0:14260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eed446 expref: 12 pid: 14237 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951742.771768:0:14260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14260:1870608624344576:0@lo:104: 00000100:00100000:3.0:1783951742.771868:0:14260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951742.771908:0:14260:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d505a2480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951742.772007:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624344576 00000100:00100000:2.0:1783951742.772016:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624344576 00000100:00100000:2.0:1783951742.772064:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951742.772083:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:14260:x1870608624344576:12345-0@lo:104: 00010000:00010000:2.0:1783951742.772097:0:14227:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772152:0:14227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951742.772157:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:14260:x1870608624344576:12345-0@lo:104: Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951742.772171:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783951742.772199:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951742.772205:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772213:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28a00 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:2.0:1783951742.772217:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772225:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951742.772232:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951742.772239:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951742.772270:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772277:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951742.772301:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772307:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28a00/0x443dabd358eed446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed44d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772325:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951742.772327:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951742.772329:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951742.772357:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3315:1870608624344704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951742.772390:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951742.772430:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624344704 00000100:00100000:2.0:1783951742.772434:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624344704 00010000:00010000:2.0:1783951742.772450:0:14229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed446 expref: 13 pid: 14237 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951742.772594:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951742.772602:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+13:3315:x1870608624344704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951742.772613:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951742.772619:0:14229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed446 expref: 13 pid: 14237 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772629:0:14229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eed446 expref: 13 pid: 14237 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772645:0:14229:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772653:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783951742.772666:0:14229:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001218729s 00010000:00010000:2.0:1783951742.772670:0:14229:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772677:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772684:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772700:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772705:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951742.772710:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772717:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772726:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772737:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951742.772767:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+13:3315:x1870608624344704:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951742.772774:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951742.772836:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3315:1870608624344704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951742.772864:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d76dfdc00/0x443dabd358eed44d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eed446 expref: 12 pid: 14237 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951742.772875:0:14260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14260:1870608624344576:0@lo:104: 00010000:00010000:2.0:1783951742.772887:0:14260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772896:0:14260:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772913:0:14260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951742.772918:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d76dfc800/0x443dabd358eed47e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951742.779614:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14226:x1870608624344448:12345-0@lo:253:mount.lustre.0 Request processed in 61433us (61551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951742.779630:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951742.779724:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14226:1870608624344448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783951742.779739:0:14226:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783951742.779743:0:14226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783951742.779745:0:14226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951742.779746:0:14226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951742.779747:0:14226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951742.779748:0:14226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951742.779750:0:14226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951742.779751:0:14226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951742.779752:0:14226:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951742.779754:0:14226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951742.779756:0:14226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783951742.779771:0:14226:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783951742.788263:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1783951742.788428:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783951742.788915:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1783951742.789154:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783951742.789442:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1783951742.789672:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1783951742.790623:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1783951742.790790:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1783951742.791313:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1783951742.791625:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1783951742.792021:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1783951742.792225:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1783951742.818877:0:14226:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1783951742.819302:0:14226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783951742.819446:0:14282:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1783951742.819451:0:14282:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1783951742.819647:0:14283:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1783951742.819719:0:14283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1783951742.824154:0:14226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783951742.824292:0:14226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951742.825375:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783951742.825449:0:14283:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783951742.825453:0:14283:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:0.0:1783951742.826059:0:14226:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783951742.826141:0:14226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783951742.826391:0:14226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951742.828325:0:14226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783951742.828997:0:14226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783951742.829038:0:14226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1783951742.832330:0:14226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1783951742.841437:0:14226:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1783951742.880620:0:14226:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783951742.880667:0:14226:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7fa41607988 00100000:10000000:0.0:1783951742.880676:0:14226:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783951742.881927:0:14226:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783951742.881948:0:14226:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783951742.881962:0:14226:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1783951742.881980:0:14226:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1783951743.478084:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951743.801549:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1783951743.869459:0:14242:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783951743.869468:0:14242:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e8c43562000 from 6 10000000:01000000:2.0:1783951743.869474:0:14242:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951743.869531:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951743.869545:0:14242:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951743.869564:0:14242:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951743.869609:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624344832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951743.869689:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951743.869746:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d47cf4000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951743.869778:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624344832 00000100:00100000:2.0:1783951743.869787:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624344832 00000100:00100000:2.0:1783951743.869874:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951743.869884:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14242:x1870608624344832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951743.869901:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951743.869916:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed485 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951743.869943:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed485 expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951743.869954:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed485 expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951743.869962:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75324600, rc 0) 00000100:00100000:2.0:1783951743.870004:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14242:x1870608624344832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951743.870012:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951743.871474:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624344832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951743.871506:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951743.871518:0:14242:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951743.871612:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624344960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783951743.871677:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951743.871709:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d47cf4000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951743.871731:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624344960 00000100:00100000:2.0:1783951743.871736:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624344960 00000100:00100000:2.0:1783951743.871777:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783951743.871785:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14242:x1870608624344960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783951743.871804:0:14238:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951743.871839:0:14238:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951743.871843:0:14238:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783951743.871924:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14242:x1870608624344960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951743.871932:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783951743.871971:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624344960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783951743.872014:0:14242:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951743.872022:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951743.872029:0:14242:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951744.503617:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951744.822442:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783951745.541723:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951746.556233:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951746.922564:0:14525:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783951747.585726:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951747.959903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951747.959911:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951747.959914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951747.959917:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951747.959920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783951747.959924:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951747.959929:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e8d50631000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951747.959944:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e8d50631000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951747.959968:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d757a7100 x1870608624345216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951747.960032:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624345216:0@lo:38:kworker.0 00000100:00100000:2.0:1783951747.960111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951747.960349:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951747.960359:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624345088:0@lo:400:kworker.0 00000100:00100000:1.0:1783951747.960395:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951747.960469:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624345216 00000100:00100000:1.0:1783951747.960477:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624345216 00000100:00100000:1.0:1783951747.960541:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951747.960550:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1870608624345216:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783951747.960580:0:14246:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:1.0:1783951747.960629:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x443dabd358eed493 00000004:00100000:1.0:1783951747.960646:0:14246:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783951747.960794:0:14246:0:(import.c:65:import_set_state_nolock()) ffff8e8d562af000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951747.960869:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1870608624345216:12345-0@lo:38:kworker.0 Request processed in 318us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951747.960887:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951747.961384:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624345088 00000100:00100000:2.0:1783951747.961389:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624345088 00000100:00100000:2.0:1783951747.961444:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951747.961452:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:3313:x1870608624345088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951747.961505:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:3313:x1870608624345088:12345-0@lo:400:kworker.0 Request processed in 54us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951747.961511:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951747.961562:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624345088:0@lo:400:kworker.0 00010000:00080000:2.0:1783951747.961595:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8d757a7100 x1870608624345216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951747.961609:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783951747.961628:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783951747.961633:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783951747.961636:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d50631000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783951747.961641:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1870608624345216:0@lo:38:kworker.0 00010000:00010000:2.0:1783951748.598157:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951749.623121:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783951749.872560:0:14676:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc34ef9f0 20000000:00000080:3.0:1783951749.872580:0:14676:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8d7b983800 uarg=0000000000000000 20000000:01000000:3.0:1783951749.872628:0:14676:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783951749.872634:0:14676:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783951749.872639:0:14676:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783951749.873436:0:14677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1783951749.873616:0:14676:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783951749.878759:0:14676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783951749.878800:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.878867:0:14676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed454 expref: 11 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.878877:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.878947:0:14676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eed454 expref: 11 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.879056:0:14676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eed454 expref: 11 pid: 14239 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951749.879072:0:14676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14676:1870608624345344:0@lo:104: 00000100:00100000:3.0:1783951749.879161:0:14676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951749.879224:0:14676:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d500e3600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951749.879336:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624345344 00000100:00100000:1.0:1783951749.879346:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624345344 00000100:00100000:1.0:1783951749.879406:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951749.879416:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:14676:x1870608624345344:12345-0@lo:104: 00010000:00010000:1.0:1783951749.879430:0:14228:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951749.879518:0:14228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951749.879525:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:14676:x1870608624345344:12345-0@lo:104: Request processed in 111us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951749.879533:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951749.881120:0:14676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14676:1870608624345344:0@lo:104: 00010000:00010000:3.0:1783951749.881153:0:14676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881201:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951749.881210:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881218:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4800 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951749.881222:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881233:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951749.881240:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951749.881246:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783951749.881296:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881303:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951749.881334:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881341:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4800/0x443dabd358eed454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed45b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881360:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951749.881362:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951749.881364:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951749.881371:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951749.881385:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3312:1870608624345472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951749.881438:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951749.881505:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624345472 00000100:00100000:3.0:1783951749.881512:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624345472 00010000:00010000:3.0:1783951749.881538:0:14229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed454 expref: 12 pid: 14239 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951749.881569:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951749.881577:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:3312:x1870608624345472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951749.881589:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951749.881594:0:14229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed454 expref: 12 pid: 14239 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881605:0:14229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eed454 expref: 12 pid: 14239 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881620:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d76dfc400/0x443dabd358eed45b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eed454 expref: 12 pid: 14239 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881636:0:14229:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881653:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881670:0:14229:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881677:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881683:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881689:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881694:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfd400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951749.881699:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881706:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881719:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881728:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951749.881759:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:3312:x1870608624345472:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951749.881767:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951749.881795:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3312:1870608624345472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951749.881847:0:14676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881855:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951749.881861:0:14676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d76dfd400/0x443dabd358eed49a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951750.646104:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783951751.285945:0:14242:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951751.285955:0:14242:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8c43562000 from 10 10000000:01000000:1.0:1783951751.285961:0:14242:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951751.286013:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951751.286026:0:14242:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951751.286035:0:14242:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951751.286061:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624345600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951751.286133:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951751.286204:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951751.286328:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624345600 00000100:00100000:2.0:1783951751.286335:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624345600 00000100:00100000:2.0:1783951751.286386:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783951751.286396:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+11:14242:x1870608624345600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951751.286412:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951751.286454:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed4a1 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951751.286486:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951751.286499:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951751.286508:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75324c00, rc 0) 00000100:00100000:2.0:1783951751.286551:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14242:x1870608624345600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951751.286557:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951751.286702:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624345600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951751.286738:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951751.286747:0:14242:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951751.286798:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624345728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951751.286912:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951751.286933:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951751.286984:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624345728 00000100:00100000:3.0:1783951751.286989:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624345728 00000100:00100000:3.0:1783951751.287022:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783951751.287030:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14242:x1870608624345728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951751.287313:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14242:x1870608624345728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951751.287321:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783951751.287400:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624345728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951751.287440:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624345856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951751.287487:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951751.287548:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951751.287692:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624345856 00000100:00100000:0.0:1783951751.287698:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624345856 00000100:00100000:0.0:1783951751.289679:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783951751.289697:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14242:x1870608624345856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951751.289956:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14242:x1870608624345856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (2469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951751.289964:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783951751.290336:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624345856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783951751.291437:0:14737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783951751.292027:0:14242:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783951751.292047:0:14242:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951751.292059:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951751.292072:0:14242:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951751.675841:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951752.059105:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951742/real 1783951742] req@ffff8e8d757a7800 x1870608624342528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951752.059142:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8d757a7800 x1870608624342528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951752.059150:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951742/real 1783951742] req@ffff8e8d757a5f80 x1870608624342400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951752.059158:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8d757a5f80 x1870608624342400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951752.059173:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d606ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951752.059188:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951752.059191:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624342528:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783951752.059197:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d601c1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951752.059202:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951752.059204:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624342400:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783951752.061026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951752.061034:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783951752.061037:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e8d601c1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951752.061044:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1783951752.061050:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783951752.061056:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8d601c1800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783951752.061091:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d65af0700 x1870608624345984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951752.061123:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951752.061126:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783951752.061127:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e8d606ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951752.061131:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1783951752.061133:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783951752.061136:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8d606ae000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783951752.061148:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d65af3100 x1870608624346112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951752.061199:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624345984:0@lo:8:kworker.0 00000400:00000100:0.0:1783951752.061251:0:3311:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870608624345984 offset 0 length 520: 4 00000100:00100000:0.0:1783951752.061303:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624346112:0@lo:8:kworker.0 00000400:00000100:0.0:1783951752.061339:0:3311:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870608624346112 offset 0 length 520: 4 00000100:00100000:2.0:1783951752.061575:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951752.061585:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624346240:0@lo:400:kworker.0 00000100:00100000:2.0:1783951752.061621:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951752.061710:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624346240 00000100:00100000:0.0:1783951752.061718:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624346240 00000100:00100000:0.0:1783951752.061798:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951752.061829:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624346240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951752.061883:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624346240:12345-0@lo:400:kworker.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951752.061890:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783951752.061972:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8d65af1180 x1870608624346240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951752.061991:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624346240:0@lo:400:kworker.0 00010000:00010000:3.0:1783951752.702940:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783951753.524693:0:14876:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783951753.524697:0:14876:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783951753.524898:0:14876:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8d79d96800 00000020:01000004:3.0:1783951753.524915:0:14876:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783951753.524928:0:14876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783951753.524943:0:14876:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e8d7f850000) 00000020:00000080:3.0:1783951753.524959:0:14876:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783951753.567722:0:14876:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783951753.568180:0:14876:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1783951753.568975:0:14876:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783951753.569215:0:14876:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1783951753.569436:0:14876:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1783951753.569788:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 515: rc = 0 00100000:10000000:1.0:1783951753.569932:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:1.0:1783951753.570026:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 515: rc = 0 00100000:10000000:1.0:1783951753.570469:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 651: rc = 0 00100000:10000000:1.0:1783951753.570857:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 651: rc = 0 00100000:10000000:1.0:1783951753.571141:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 651: rc = 0 00100000:10000000:1.0:1783951753.572323:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 651: rc = 0 00100000:10000000:1.0:1783951753.572640:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 651: rc = 0 00100000:10000000:1.0:1783951753.573399:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 651: rc = 0 00000020:00000080:1.0:1783951753.574255:0:14876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783951753.574267:0:14876:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783951753.574278:0:14876:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x443dabd358eed4b6 00000020:01000004:1.0:1783951753.574285:0:14876:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1783951753.574306:0:14876:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783951753.574310:0:14876:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783951753.574315:0:14876:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783951753.574320:0:14876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783951753.574329:0:14876:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e8d65ab19c0) 00000020:00000080:1.0:1783951753.574338:0:14876:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1783951753.581666:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783951753.581858:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783951753.581864:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783951753.587427:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783951753.587444:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783951753.596234:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783951753.596249:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783951753.600143:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951753.600330:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783951753.600337:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783951753.601429:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783951753.601438:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783951753.628164:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951753.628436:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783951753.628443:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783951753.630490:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783951753.630504:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783951753.631465:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783951753.631477:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783951753.635306:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951753.635527:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783951753.635534:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783951753.636612:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783951753.636621:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783951753.676593:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951753.677471:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783951753.677489:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1783951753.679715:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1783951753.679728:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783951753.680467:0:14876:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783951753.680493:0:14876:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1783951753.680500:0:14876:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783951753.716467:0:14876:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783951753.716520:0:14876:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783951753.716524:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783951753.716526:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783951753.716527:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951753.716529:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951753.716530:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951753.716531:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951753.716532:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951753.716534:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951753.716536:0:14876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783951753.716539:0:14876:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783951753.716542:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783951753.716543:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783951753.716544:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951753.716545:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951753.716546:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951753.716547:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951753.716548:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951753.716549:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951753.716550:0:14876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783951753.716579:0:14876:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783951753.716602:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346368:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783951753.716676:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951753.716791:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452f59c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783951753.719373:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951753.725227:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624346368 00000100:00100000:0.0:1783951753.725245:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624346368 00000100:00100000:1.0:1783951753.725961:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783951753.725974:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14876:x1870608624346368:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783951753.726014:0:14237:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783951753.726018:0:14237:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783951753.726023:0:14237:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783951753.738591:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14876:x1870608624346368:12345-0@lo:253:mount.lustre.0 Request processed in 12609us (21903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951753.738608:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783951753.738739:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346368:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783951753.738757:0:14876:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783951753.738761:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783951753.738762:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783951753.738764:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951753.738765:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951753.738767:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951753.738768:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951753.738770:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951753.738771:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951753.738773:0:14876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783951753.738794:0:14876:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8d79d96800 from lustre-OST0000 10000000:01000000:3.0:1783951753.741026:0:14876:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783951753.741037:0:14876:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783951753.741045:0:14876:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8d7f8519c0 local copy 00010000:00010000:3.0:1783951753.741059:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951753.741312:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951753.741362:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951753.741417:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.741516:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624346496 00000100:00100000:2.0:1783951753.741531:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624346496 00000100:00100000:2.0:1783951753.741589:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783951753.741600:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14876:x1870608624346496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951753.741977:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14876:x1870608624346496:12345-0@lo:501:mount.lustre.0 Request processed in 379us (612us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951753.741986:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783951753.742085:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346496:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783951753.742104:0:14876:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783951753.742269:0:14876:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783951753.742276:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.742285:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951753.742308:0:14876:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8d79d96800 10000000:01000000:0.0:1783951753.742313:0:14876:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783951753.742317:0:14876:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e8d7f8519c0 10000000:01000000:0.0:1783951753.742319:0:14876:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783951753.742323:0:14876:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8e8d7f8519c0 from 1 10000000:01000000:0.0:1783951753.742326:0:14876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783951753.742349:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5a00/0x443dabd358eed4c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.742357:0:14876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5a00/0x443dabd358eed4c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.742365:0:14876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5a00/0x443dabd358eed4c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951753.742378:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951753.742419:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.742449:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951753.742516:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624346624 00000100:00100000:1.0:1783951753.742527:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624346624 00000100:00100000:1.0:1783951753.742636:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951753.742645:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+12:14876:x1870608624346624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951753.742654:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951753.742667:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e29800/0x443dabd358eed4cb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed4c4 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.742700:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e29800/0x443dabd358eed4cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed4c4 expref: 13 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.742711:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e29800/0x443dabd358eed4cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed4c4 expref: 13 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.742720:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29800, rc 0) 00000100:00100000:1.0:1783951753.742760:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+13:14876:x1870608624346624:12345-0@lo:101:mount.lustre.0 Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951753.742766:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783951753.742881:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951753.742902:0:14876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5a00/0x443dabd358eed4c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4cb expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.742910:0:14876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5a00/0x443dabd358eed4c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed4cb expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951753.742926:0:14876:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783951753.742937:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5a00/0x443dabd358eed4c4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4cb expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.742944:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5a00/0x443dabd358eed4c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4cb expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951753.742950:0:14876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783951753.742962:0:14876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951753.742966:0:14876:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783951753.742969:0:14876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783951753.742983:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4200/0x443dabd358eed4d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.742990:0:14876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4200/0x443dabd358eed4d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.742998:0:14876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4200/0x443dabd358eed4d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951753.743010:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951753.743035:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.743282:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.743338:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624346752 00000100:00100000:2.0:1783951753.743343:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624346752 00000100:00100000:2.0:1783951753.743366:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951753.743374:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+13:14876:x1870608624346752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951753.743382:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951753.743403:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d75324800/0x443dabd358eed4d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed4d2 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.743419:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75324800/0x443dabd358eed4d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed4d2 expref: 14 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.743427:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d75324800/0x443dabd358eed4d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed4d2 expref: 14 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.743434:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75324800, rc 0) 00000100:00100000:2.0:1783951753.743472:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624346752:12345-0@lo:101:mount.lustre.0 Request processed in 99us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.743478:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783951753.743551:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951753.743561:0:14876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4200/0x443dabd358eed4d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4d9 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.743568:0:14876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4200/0x443dabd358eed4d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed4d9 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951753.744562:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783951753.745635:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951753.746176:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783951753.746222:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783951753.746255:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783951753.746302:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783951753.746340:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783951753.746374:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783951753.746452:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783951753.746461:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783951753.746546:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951753.746607:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.746642:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.747130:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624346880 00000100:00100000:2.0:1783951753.747137:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624346880 00000100:00100000:2.0:1783951753.747176:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783951753.747185:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624346880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951753.747578:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624346880:12345-0@lo:501:mount.lustre.0 Request processed in 392us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.747586:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783951753.747759:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624346880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951753.747795:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951753.747960:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.747980:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.748027:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624347008 00000100:00100000:2.0:1783951753.748032:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624347008 00000100:00100000:2.0:1783951753.748049:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783951753.748054:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624347008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951753.748331:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624347008:12345-0@lo:503:mount.lustre.0 Request processed in 276us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.748338:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783951753.748416:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347008:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951753.749623:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951753.749954:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951753.750020:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.750102:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.750137:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624347136 00000100:00100000:2.0:1783951753.750143:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624347136 00000100:00100000:2.0:1783951753.750225:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783951753.750236:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624347136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951753.750478:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624347136:12345-0@lo:502:mount.lustre.0 Request processed in 243us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.750486:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783951753.750558:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951753.750806:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783951753.750899:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783951753.750937:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783951753.750985:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783951753.751021:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783951753.751057:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783951753.751123:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783951753.751164:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783951753.751199:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1783951753.751247:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1783951753.751284:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1783951753.751331:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1783951753.751362:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951753.751416:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.752003:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951753.752044:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624347264 00000100:00100000:3.0:1783951753.752050:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624347264 00000100:00100000:2.0:1783951753.752110:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783951753.752119:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624347264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951753.752302:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624347264:12345-0@lo:502:mount.lustre.0 Request processed in 183us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.752310:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783951753.752382:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951753.752472:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1783951753.752486:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1783951753.753457:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783951753.753465:0:14890:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1783951753.753471:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951753.753474:0:14890:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783951753.753482:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951753.753497:0:14890:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e8d65ab4d40) 00000020:00000080:1.0:1783951753.753515:0:14890:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783951753.753521:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783951753.753589:0:14890:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8d79d96800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783951753.753597:0:14890:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783951753.753609:0:14890:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x443dabd358eed4e7 00010000:00010000:1.0:1783951753.759320:0:14890:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1783951753.762780:0:14890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1783951753.766081:0:14890:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1783951753.768004:0:14890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783951753.768016:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951753.768022:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951753.768025:0:14890:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783951753.768029:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783951753.768031:0:14890:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1783951753.768033:0:14890:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951753.768035:0:14890:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951753.768036:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783951753.768039:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951753.768040:0:14890:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783951753.768042:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951753.768045:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951753.768047:0:14890:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783951753.768050:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783951753.768052:0:14890:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783951753.768054:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951753.768056:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951753.768058:0:14890:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783951753.768060:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951753.768062:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951753.768063:0:14890:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783951753.768067:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783951753.768126:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951753.768130:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951753.768131:0:14890:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783951753.768135:0:14890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1783951753.768414:0:14876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783951753.768442:0:14876:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783951753.768468:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4200/0x443dabd358eed4d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4d9 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.768489:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4200/0x443dabd358eed4d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4d9 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951753.768498:0:14876:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d79d96800 from 1 10000000:01000000:2.0:1783951753.768501:0:14876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951753.768539:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.768549:0:14876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.768560:0:14876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951753.768583:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951753.768653:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951753.768689:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.768982:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624347392 00000100:00100000:2.0:1783951753.768990:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624347392 00000100:00100000:2.0:1783951753.769029:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951753.769039:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+14:14876:x1870608624347392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951753.769054:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951753.769067:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed4ee expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.769089:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed4ee expref: 15 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.769111:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed4ee expref: 15 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.769119:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325600, rc 0) 00000100:00100000:2.0:1783951753.769157:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347392:12345-0@lo:101:mount.lustre.0 Request processed in 119us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.769163:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951753.769211:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951753.769225:0:14876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951753.769234:0:14876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951753.769744:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783951753.770342:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951753.770609:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783951753.770660:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783951753.770725:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783951753.770733:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783951753.770793:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951753.771113:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951753.771200:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951753.771257:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624347520 00000100:00100000:0.0:1783951753.771265:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624347520 00000100:00100000:0.0:1783951753.771347:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783951753.771357:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951753.771603:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347520:12345-0@lo:501:mount.lustre.0 Request processed in 247us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951753.771611:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783951753.772061:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951753.772102:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951753.772144:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951753.779677:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5866f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.779755:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624347648 00000100:00100000:2.0:1783951753.779765:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624347648 00000100:00100000:0.0:1783951753.780158:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783951753.780170:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951753.780541:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347648:12345-0@lo:503:mount.lustre.0 Request processed in 373us (8394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951753.780551:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783951753.780746:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951753.781777:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951753.782467:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951753.782551:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.782631:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d518af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.782711:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624347776 00000100:00100000:2.0:1783951753.782719:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624347776 00000100:00100000:2.0:1783951753.782802:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783951753.783195:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951753.783451:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347776:12345-0@lo:502:mount.lustre.0 Request processed in 260us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.783460:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951753.783549:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951753.784098:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783951753.784161:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783951753.784223:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783951753.784277:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783951753.784315:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783951753.784365:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783951753.784414:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783951753.784452:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1783951753.784490:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951753.784544:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951753.784799:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5866fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951753.785105:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624347904 00000100:00100000:0.0:1783951753.785112:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624347904 00000100:00100000:3.0:1783951753.785176:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783951753.785186:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951753.785370:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624347904:12345-0@lo:502:mount.lustre.0 Request processed in 185us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951753.785378:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951753.785472:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624347904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951753.785589:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783951753.785600:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783951753.786706:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951753.786716:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951753.786719:0:14894:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783951753.786725:0:14894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d79d96800 00000020:00000080:0.0:1783951753.786728:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951753.786736:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951753.786739:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951753.786741:0:14894:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783951753.786744:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951753.786746:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951753.786747:0:14894:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783951753.786751:0:14894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d79d96800 00000020:00000080:0.0:1783951753.786753:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951753.788110:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951753.788117:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951753.788118:0:14894:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783951753.788122:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951753.788125:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951753.788127:0:14894:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783951753.788130:0:14894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8d79d96800 00000020:00000080:0.0:1783951753.788144:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951753.790076:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951753.790090:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951753.790092:0:14894:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783951753.790098:0:14894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783951753.790401:0:14876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783951753.790432:0:14876:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951753.790458:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.790471:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951753.790523:0:14876:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783951753.790527:0:14876:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8d79d96800 10000000:01000000:1.0:1783951753.790531:0:14876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8d79d96800 10000000:01000000:1.0:1783951753.790535:0:14876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951753.790549:0:14876:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d79d96800 from 1 10000000:01000000:1.0:1783951753.790552:0:14876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951753.790588:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28c00/0x443dabd358eed4fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.790597:0:14876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28c00/0x443dabd358eed4fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.790608:0:14876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28c00/0x443dabd358eed4fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951753.790635:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951753.790700:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951753.790741:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624348032 00000100:00100000:1.0:1783951753.790748:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624348032 00000100:00100000:1.0:1783951753.790787:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783951753.790795:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624348032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951753.790829:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951753.790841:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e28a00/0x443dabd358eed503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed4fc expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.790863:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e28a00/0x443dabd358eed503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed4fc expref: 16 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.790873:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e28a00/0x443dabd358eed503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed4fc expref: 16 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.790883:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28a00, rc 0) 00000100:00100000:1.0:1783951753.791344:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348032:12345-0@lo:101:mount.lustre.0 Request processed in 548us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951753.791361:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783951753.791420:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5866f840 going to sleep for 11 seconds 00000100:00100000:1.0:1783951753.791444:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951753.791458:0:14876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28c00/0x443dabd358eed4fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed503 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.791468:0:14876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28c00/0x443dabd358eed4fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed503 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951753.794409:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1783951753.794863:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951753.800201:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783951753.800301:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783951753.800337:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783951753.800404:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783951753.800444:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783951753.800523:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783951753.800563:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783951753.800596:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783951753.800649:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783951753.800687:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783951753.800723:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783951753.800777:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783951753.800837:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783951753.803342:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783951753.803479:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783951753.803524:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783951753.803565:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783951753.803623:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783951753.803664:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783951753.803713:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783951753.803769:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783951753.805090:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783951753.805147:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783951753.805213:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783951753.805253:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1783951753.805289:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1783951753.805340:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1783951753.805378:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1783951753.805480:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1783951753.805488:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1783951753.805609:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951753.805684:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951753.805735:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5866f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951753.806093:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624348160 00000100:00100000:0.0:1783951753.806101:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624348160 00000100:00100000:0.0:1783951753.806159:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783951753.806169:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951753.806469:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348160:12345-0@lo:501:mount.lustre.0 Request processed in 301us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951753.806478:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783951753.807100:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951753.807139:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951753.807176:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951753.807195:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624348288 00000100:00100000:2.0:1783951753.807199:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624348288 00000100:00100000:2.0:1783951753.807223:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951753.807227:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951753.807338:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348288:12345-0@lo:503:mount.lustre.0 Request processed in 110us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.807342:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951753.807366:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951753.807374:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783951753.809568:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951753.809672:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951753.809745:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951753.809874:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951753.817145:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624348416 00000100:00100000:0.0:1783951753.817162:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624348416 00000100:00100000:0.0:1783951753.817242:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951753.817254:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951753.817584:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348416:12345-0@lo:502:mount.lustre.0 Request processed in 332us (7838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951753.817593:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783951753.817776:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951753.818106:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783951753.818167:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783951753.818205:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783951753.818252:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783951753.818286:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783951753.818344:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783951753.818382:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783951753.818434:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783951753.818484:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783951753.818522:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783951753.818570:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783951753.818623:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783951753.818660:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783951753.818704:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783951753.818755:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783951753.818791:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783951753.818858:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783951753.820964:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783951753.821065:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783951753.821102:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783951753.821161:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783951753.821201:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783951753.821234:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783951753.821276:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783951753.821313:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1783951753.821347:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1783951753.821431:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1783951753.821466:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1783951753.821499:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1783951753.821544:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1783951753.821580:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1783951753.821613:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783951753.821642:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1783951753.821699:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783951753.821738:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783951753.821804:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783951753.821893:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783951753.823903:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783951753.824857:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783951753.824900:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783951753.824969:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951753.825050:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951753.825090:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d5866f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951753.825166:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624348544 00000100:00100000:0.0:1783951753.825176:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624348544 00000100:00100000:0.0:1783951753.825261:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783951753.825273:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951753.825648:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348544:12345-0@lo:502:mount.lustre.0 Request processed in 376us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951753.825657:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783951753.825746:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951753.826094:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1783951753.826109:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1783951753.835320:0:14899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783951753.835338:0:14899:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e8d605399c0) 00000020:00000080:2.0:1783951753.835363:0:14899:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1783951753.835589:0:14899:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8d79d96800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783951753.835595:0:14899:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8d79d96800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783951753.835603:0:14899:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d79d96800 3 00010000:00080000:2.0:1783951753.835636:0:14899:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d7f754000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1783951753.843469:0:14899:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1783951753.843583:0:14899:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783951753.843624:0:14899:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951753.843638:0:14899:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x443dabd358eed511 00000100:00080000:2.0:1783951753.843649:0:14899:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951753.843655:0:14899:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e8d7f754000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1783951753.843696:0:14899:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d757a5c00 x1870608624348672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951753.843916:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1870608624348672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951753.844018:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951753.844125:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624348672 00000100:00100000:1.0:1783951753.844132:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624348672 00000100:00100000:1.0:1783951753.844168:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951753.844176:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1870608624348672:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783951753.844211:0:14244:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:1.0:1783951753.844246:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x443dabd358eed518 00000004:00100000:1.0:1783951753.844260:0:14244:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783951753.844289:0:14244:0:(import.c:65:import_set_state_nolock()) ffff8e8d79d90000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783951753.844372:0:14899:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783951753.853412:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1870608624348672:12345-0@lo:38:llog_process_th.0 Request processed in 9221us (9381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951753.853428:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783951753.853908:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951753.853914:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951753.853917:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951753.853920:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951753.854001:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624348800:0@lo:400:kworker.0 00000100:00100000:3.0:1783951753.854071:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783951753.854455:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1783951753.854606:0:14876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783951753.854636:0:14876:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951753.854654:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28c00/0x443dabd358eed4fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed503 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951753.854668:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d42e28c00/0x443dabd358eed4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed503 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783951753.854723:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783951753.854725:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951753.854727:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951753.854728:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951753.854730:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951753.854731:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951753.854732:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951753.854734:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951753.854735:0:14876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951753.854741:0:14876:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783951753.854744:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951753.854745:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951753.854747:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951753.854748:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951753.854749:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951753.854750:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951753.854756:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951753.854757:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951753.854758:0:14876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951753.854778:0:14876:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783951753.854792:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951753.854855:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951753.854881:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d50b39180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951753.856076:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624348800 00000100:00100000:3.0:1783951753.856086:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624348800 00000100:00100000:3.0:1783951753.856140:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951753.856151:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624348800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951753.856235:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624348800:12345-0@lo:400:kworker.0 Request processed in 85us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951753.856243:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783951753.856325:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8d8133ad80 x1870608624348800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951753.856341:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624348800:0@lo:400:kworker.0 00000100:00100000:1.0:1783951753.857870:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624348928 00000100:00100000:1.0:1783951753.857882:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624348928 00000100:00100000:1.0:1783951753.858071:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783951753.858079:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14876:x1870608624348928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783951753.858112:0:14239:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783951753.858128:0:14239:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1783951753.859484:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8d757a5c00 x1870608624348672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951753.859500:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951753.859513:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783951753.859522:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783951753.859528:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783951753.859532:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d7f754000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951753.859540:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1870608624348672:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1783951753.895047:0:14239:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783951753.895067:0:14239:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783951753.895090:0:14260:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783951753.895095:0:14260:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783951753.895119:0:14260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895143:0:14260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed485 expref: 16 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895154:0:14260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895207:0:14260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eed485 expref: 16 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895222:0:14260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eed485 expref: 16 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951753.895239:0:14260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14260:1870608624349056:0@lo:104: 00000100:00100000:0.0:1783951753.895329:0:14260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.895371:0:14260:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d452f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951753.895412:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624349056 00000100:00100000:0.0:1783951753.895421:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624349056 00000100:00100000:0.0:1783951753.895469:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951753.895480:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:14260:x1870608624349056:12345-0@lo:104: 00010000:00010000:0.0:1783951753.895495:0:14228:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895548:0:14228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951753.895553:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:14260:x1870608624349056:12345-0@lo:104: Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951753.895560:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783951753.895586:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951753.895592:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895600:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:0.0:1783951753.895604:0:14232:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895612:0:14232:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951753.895618:0:14232:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951753.895624:0:14232:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951753.895652:0:14232:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895668:0:14232:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951753.895689:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895696:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d75324000/0x443dabd358eed485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed48c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895712:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951753.895714:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951753.895716:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951753.895740:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3312:1870608624349184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951753.895767:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951753.895860:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624349184 00000100:00100000:0.0:1783951753.895864:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624349184 00010000:00010000:0.0:1783951753.895882:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed485 expref: 17 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951753.895904:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951753.895910:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:3312:x1870608624349184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951753.895921:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951753.895926:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed485 expref: 17 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.895937:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eed485 expref: 17 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896031:0:14231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896049:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783951753.896062:0:14231:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001218729s 00010000:00010000:0.0:1783951753.896066:0:14231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896073:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896080:0:14231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896087:0:14231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896093:0:14231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951753.896097:0:14231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896104:0:14231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896113:0:14231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896121:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951753.896151:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:3312:x1870608624349184:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951753.896158:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951753.896218:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3312:1870608624349184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951753.896249:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d75324600/0x443dabd358eed48c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eed485 expref: 16 pid: 14239 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951753.896259:0:14260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14260:1870608624349056:0@lo:104: 00010000:00010000:0.0:1783951753.896272:0:14260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896282:0:14260:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896288:0:14260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951753.896294:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce5200/0x443dabd358eed51f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951753.903792:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14876:x1870608624348928:12345-0@lo:253:mount.lustre.0 Request processed in 45704us (48927us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951753.903838:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783951753.904082:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14876:1870608624348928:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783951753.904099:0:14876:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783951753.904103:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783951753.904105:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951753.904106:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951753.904108:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951753.904109:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951753.904110:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951753.904112:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951753.904114:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951753.904115:0:14876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783951753.904131:0:14876:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783951753.909472:0:14876:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783951753.909631:0:14876:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783951753.909770:0:14876:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783951753.910052:0:14876:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783951753.910174:0:14876:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783951753.910363:0:14876:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783951753.911328:0:14876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783951753.955339:0:14876:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783951753.955349:0:14876:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783951753.955395:0:14876:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783951753.955465:0:14876:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783951753.955478:0:14876:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783951753.955505:0:14876:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:2.0:1783951754.039487:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783951754.742046:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783951755.129693:0:14242:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783951755.129716:0:14242:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e8c43562000 from 7 10000000:01000000:1.0:1783951755.129722:0:14242:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951755.129771:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951755.129784:0:14242:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951755.129796:0:14242:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951755.129956:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624349312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951755.130029:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951755.130115:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951755.130156:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624349312 00000100:00100000:0.0:1783951755.130164:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624349312 00000100:00100000:0.0:1783951755.130248:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951755.130258:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+15:14242:x1870608624349312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951755.130273:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951755.130288:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed526 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951755.130314:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed526 expref: 16 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951755.130325:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed526 expref: 16 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951755.130347:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce5800, rc 0) 00000100:00100000:0.0:1783951755.130405:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14242:x1870608624349312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951755.130412:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951755.130482:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624349312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951755.130496:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951755.130504:0:14242:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951755.130551:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624349440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783951755.130584:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951755.130661:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951755.130713:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624349440 00000100:00100000:3.0:1783951755.130717:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624349440 00000100:00100000:3.0:1783951755.130738:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783951755.130744:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14242:x1870608624349440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783951755.130757:0:14238:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783951755.130772:0:14238:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951755.130776:0:14238:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783951755.130880:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14242:x1870608624349440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951755.130887:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783951755.130955:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624349440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783951755.131009:0:14242:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951755.131016:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951755.131034:0:14242:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951755.766213:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951756.790417:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951757.814532:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951758.838101:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951759.225847:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951759.225855:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951759.225857:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951759.225860:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951759.225924:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624349696:0@lo:400:kworker.0 00000100:00100000:1.0:1783951759.225994:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951759.226051:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951759.226057:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624349824:0@lo:400:kworker.0 00000100:00100000:1.0:1783951759.226082:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951759.226126:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624349696 00000100:00100000:1.0:1783951759.226133:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624349696 00000100:00100000:1.0:1783951759.226172:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624349824 00000100:00100000:1.0:1783951759.226176:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624349824 00000100:00100000:1.0:1783951759.226203:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951759.226211:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624349696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951759.226258:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624349696:12345-0@lo:400:kworker.0 Request processed in 49us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951759.226264:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951759.226279:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951759.226284:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624349824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951759.226319:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624349824:12345-0@lo:400:kworker.0 Request processed in 35us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951759.226337:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783951759.226371:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783951759.226398:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d811a5c00 x1870608624349824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951759.226411:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624349824:0@lo:400:kworker.0 00010000:00080000:1.0:1783951759.226420:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d811a7b80 x1870608624349696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951759.226427:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624349696:0@lo:400:kworker.0 00000100:00100000:0.0:1783951759.226916:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624349568:0@lo:400:kworker.0 00000100:00100000:0.0:1783951759.226966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951759.227008:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624349568 00000100:00100000:0.0:1783951759.227014:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624349568 00000100:00100000:0.0:1783951759.227044:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783951759.227050:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:3313:x1870608624349568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951759.227088:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:3313:x1870608624349568:12345-0@lo:400:kworker.0 Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951759.227095:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783951759.227134:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624349568:0@lo:400:kworker.0 00010000:00010000:3.0:1783951759.862072:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951760.350546:0:15244:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783951760.886184:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951761.911980:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951762.934300:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951763.960445:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951764.283101:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1783951764.344326:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951764.344333:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951764.344336:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951764.344339:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783951764.344387:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624350080:0@lo:400:kworker.0 00000100:00100000:2.0:1783951764.344452:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951764.344496:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951764.344501:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624349952:0@lo:400:kworker.0 00000100:00100000:2.0:1783951764.344526:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951764.344556:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624349952 00000100:00100000:2.0:1783951764.344563:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624349952 00000100:00100000:2.0:1783951764.344602:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951764.344609:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:3313:x1870608624349952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951764.344652:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:3313:x1870608624349952:12345-0@lo:400:kworker.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951764.344660:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951764.344702:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624349952:0@lo:400:kworker.0 00000100:00100000:1.0:1783951764.345291:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624350208:0@lo:400:kworker.0 00000100:00100000:1.0:1783951764.345329:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951764.345368:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624350080 00000100:00100000:1.0:1783951764.345373:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624350080 00000100:00100000:1.0:1783951764.345404:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624350208 00000100:00100000:1.0:1783951764.345406:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624350208 00000100:00100000:1.0:1783951764.345428:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951764.345434:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624350080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951764.345475:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624350080:12345-0@lo:400:kworker.0 Request processed in 40us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951764.345481:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951764.345494:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951764.345500:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624350208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951764.345529:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624350208:12345-0@lo:400:kworker.0 Request processed in 30us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951764.345535:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1783951764.345569:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783951764.345594:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d757a7480 x1870608624350080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951764.345606:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624350080:0@lo:400:kworker.0 00010000:00080000:1.0:1783951764.345627:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d757a5180 x1870608624350208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951764.345634:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624350208:0@lo:400:kworker.0 00010000:00010000:3.0:1783951764.983112:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951766.005987:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783951766.550110:0:15546:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783951766.550115:0:15546:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1783951766.550283:0:15546:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8d50910000 00000020:01000004:3.0:1783951766.550300:0:15546:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783951766.550315:0:15546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1783951766.550329:0:15546:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e8d585e0000) 00000020:00000080:3.0:1783951766.550349:0:15546:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783951766.571738:0:15546:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783951766.572206:0:15546:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783951766.573288:0:15546:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783951766.573537:0:15546:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783951766.575519:0:15546:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783951766.576197:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 517: rc = 0 00100000:10000000:2.0:1783951766.576291:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:2.0:1783951766.576426:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 517: rc = 0 00100000:10000000:2.0:1783951766.578292:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 317: rc = 0 00100000:10000000:2.0:1783951766.578584:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 317: rc = 0 00100000:10000000:2.0:1783951766.579070:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 317: rc = 0 00100000:10000000:2.0:1783951766.579462:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 317: rc = 0 00100000:10000000:2.0:1783951766.580627:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 317: rc = 0 00100000:10000000:2.0:1783951766.581256:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 317: rc = 0 00000020:00000080:2.0:1783951766.582801:0:15546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783951766.583014:0:15546:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783951766.583029:0:15546:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x443dabd358eed53b 00000020:01000004:2.0:1783951766.583039:0:15546:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1783951766.583062:0:15546:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783951766.583065:0:15546:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783951766.583072:0:15546:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783951766.583099:0:15546:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1783951766.583103:0:15546:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783951766.617064:0:15546:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783951766.617108:0:15546:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783951766.617113:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783951766.617115:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783951766.617116:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951766.617117:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951766.617118:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951766.617119:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951766.617121:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951766.617123:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951766.617124:0:15546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783951766.617128:0:15546:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783951766.617130:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783951766.617131:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783951766.617133:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951766.617134:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951766.617135:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951766.617136:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951766.617137:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951766.617138:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951766.617140:0:15546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783951766.617181:0:15546:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783951766.617204:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783951766.617292:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.617402:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951766.617571:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624350336 00000100:00100000:0.0:1783951766.617580:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624350336 00000100:00100000:0.0:1783951766.617776:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783951766.617787:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:15546:x1870608624350336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783951766.618105:0:14237:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783951766.618109:0:14237:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1783951766.618121:0:14237:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783951766.638303:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:15546:x1870608624350336:12345-0@lo:253:mount.lustre.0 Request processed in 20509us (21002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951766.638319:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783951766.638764:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350336:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783951766.638790:0:15546:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783951766.638793:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783951766.638795:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783951766.638797:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951766.638798:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951766.638799:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951766.638800:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951766.638802:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951766.638803:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951766.638805:0:15546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783951766.639438:0:15546:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8d50910000 from lustre-OST0001 10000000:01000000:0.0:1783951766.639468:0:15546:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783951766.639472:0:15546:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783951766.639479:0:15546:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8d7f8519c0 local copy 00010000:00010000:0.0:1783951766.639490:0:15546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951766.639870:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951766.639921:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951766.640008:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d42467300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951766.640050:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624350464 00000100:00100000:2.0:1783951766.640059:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624350464 00000100:00100000:2.0:1783951766.640141:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951766.640152:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:15546:x1870608624350464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951766.640386:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:15546:x1870608624350464:12345-0@lo:501:mount.lustre.0 Request processed in 235us (463us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951766.640394:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783951766.640471:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350464:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783951766.640489:0:15546:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783951766.640651:0:15546:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783951766.640659:0:15546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.640679:0:15546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce4600/0x443dabd358eed3ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed3b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951766.640701:0:15546:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8d50910000 10000000:01000000:3.0:1783951766.640706:0:15546:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783951766.640711:0:15546:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783951766.640713:0:15546:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783951766.640717:0:15546:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783951766.640720:0:15546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783951766.640742:0:15546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfd400/0x443dabd358eed542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.640750:0:15546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfd400/0x443dabd358eed542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.640759:0:15546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfd400/0x443dabd358eed542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951766.640778:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783951766.640829:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.641547:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951766.641737:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624350592 00000100:00100000:0.0:1783951766.641745:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624350592 00000100:00100000:0.0:1783951766.641781:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783951766.641789:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:15546:x1870608624350592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951766.641802:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951766.641841:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4e00/0x443dabd358eed549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed542 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.641867:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4e00/0x443dabd358eed549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed542 expref: 17 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.641877:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce4e00/0x443dabd358eed549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed542 expref: 17 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.641885:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4e00, rc 0) 00000100:00100000:0.0:1783951766.641926:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624350592:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951766.641932:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783951766.642027:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951766.642042:0:15546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfd400/0x443dabd358eed542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed549 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.642052:0:15546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfd400/0x443dabd358eed542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed549 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951766.642727:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783951766.643564:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951766.643792:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783951766.643867:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783951766.643902:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783951766.643952:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783951766.643993:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783951766.644027:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783951766.644095:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783951766.644103:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783951766.644195:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951766.644257:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.644299:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951766.644554:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624350720 00000100:00100000:0.0:1783951766.644564:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624350720 00000100:00100000:0.0:1783951766.644617:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783951766.644627:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624350720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951766.645009:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624350720:12345-0@lo:501:mount.lustre.0 Request processed in 382us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951766.645017:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783951766.645430:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951766.645471:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951766.645513:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.645551:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951766.645829:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624350848 00000100:00100000:2.0:1783951766.645836:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624350848 00000100:00100000:2.0:1783951766.645869:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951766.645876:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624350848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951766.646183:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624350848:12345-0@lo:503:mount.lustre.0 Request processed in 307us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951766.646191:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783951766.646548:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783951766.647334:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951766.647428:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951766.647478:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.647519:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951766.647759:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624350976 00000100:00100000:2.0:1783951766.647766:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624350976 00000100:00100000:2.0:1783951766.647829:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783951766.647844:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624350976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951766.648035:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624350976:12345-0@lo:502:mount.lustre.0 Request processed in 192us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951766.648042:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783951766.648421:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624350976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951766.648790:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783951766.648990:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783951766.649027:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783951766.649080:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783951766.649121:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783951766.649157:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783951766.649220:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783951766.649259:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783951766.649312:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1783951766.649352:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951766.649408:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.649447:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951766.649509:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624351104 00000100:00100000:2.0:1783951766.649515:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624351104 00000100:00100000:2.0:1783951766.649562:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951766.649572:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624351104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951766.650049:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624351104:12345-0@lo:502:mount.lustre.0 Request processed in 477us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951766.650057:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783951766.650230:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951766.650311:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1783951766.650323:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1783951766.651382:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783951766.651391:0:15547:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1783951766.651398:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951766.651401:0:15547:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783951766.651406:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783951766.651424:0:15547:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e8d81660000) 00000020:00000080:0.0:1783951766.651449:0:15547:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783951766.651459:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783951766.651527:0:15547:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8d50910000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1783951766.651534:0:15547:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783951766.651541:0:15547:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x443dabd358eed557 00010000:00010000:0.0:1783951766.659132:0:15547:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1783951766.660099:0:15547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1783951766.662427:0:15547:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1783951766.669482:0:15547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783951766.669502:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951766.669511:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951766.669514:0:15547:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783951766.669517:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951766.669522:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951766.669523:0:15547:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783951766.669527:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783951766.669529:0:15547:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783951766.669532:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951766.669540:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951766.669542:0:15547:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783951766.669545:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951766.669547:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951766.669548:0:15547:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783951766.669552:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783951766.669635:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951766.669639:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951766.669640:0:15547:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783951766.669643:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1783951766.669910:0:15546:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1783951766.669947:0:15546:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783951766.669973:0:15546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfd400/0x443dabd358eed542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed549 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.669985:0:15546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfd400/0x443dabd358eed542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed549 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951766.669995:0:15546:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d50910000 from 1 10000000:01000000:0.0:1783951766.669998:0:15546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951766.670048:0:15546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.670057:0:15546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.670069:0:15546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951766.670095:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951766.670190:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951766.670242:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624351232 00000100:00100000:0.0:1783951766.670250:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624351232 00000100:00100000:0.0:1783951766.670295:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783951766.670305:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:15546:x1870608624351232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951766.670321:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951766.670334:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed55e expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.670356:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed55e expref: 18 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.670366:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed55e expref: 18 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.670374:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d65ce4800, rc 0) 00000100:00100000:0.0:1783951766.670408:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351232:12345-0@lo:101:mount.lustre.0 Request processed in 104us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951766.670415:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783951766.670459:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d43500900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951766.670481:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951766.670495:0:15546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.670505:0:15546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951766.672531:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783951766.674076:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951766.674366:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783951766.674431:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783951766.674501:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783951766.674509:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1783951766.676295:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951766.676383:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951766.676465:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d43500900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951766.678277:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624351360 00000100:00100000:2.0:1783951766.678291:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624351360 00000100:00100000:3.0:1783951766.681921:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783951766.681938:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951766.682284:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351360:12345-0@lo:501:mount.lustre.0 Request processed in 350us (5900us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951766.682293:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783951766.682721:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951766.682780:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951766.682853:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951766.682894:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7592d300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951766.682951:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624351488 00000100:00100000:2.0:1783951766.682959:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624351488 00000100:00100000:2.0:1783951766.682998:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951766.683006:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951766.683363:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351488:12345-0@lo:503:mount.lustre.0 Request processed in 356us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951766.683369:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783951766.687348:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783951766.688007:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951766.688105:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951766.688195:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.688239:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d561e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951766.688265:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624351616 00000100:00100000:0.0:1783951766.688272:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624351616 00000100:00100000:0.0:1783951766.688324:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783951766.688336:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951766.688591:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351616:12345-0@lo:502:mount.lustre.0 Request processed in 258us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951766.688599:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783951766.690412:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951766.690895:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783951766.690962:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783951766.691015:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783951766.691054:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783951766.691092:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783951766.691143:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783951766.692384:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783951766.693342:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1783951766.693421:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951766.693543:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.695913:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44d87840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951766.703689:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624351744 00000100:00100000:0.0:1783951766.703705:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624351744 00000100:00100000:0.0:1783951766.703777:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783951766.703788:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951766.704800:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351744:12345-0@lo:502:mount.lustre.0 Request processed in 1012us (11254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951766.704829:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783951766.708938:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951766.709162:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783951766.709191:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1783951766.712041:0:15551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951766.712067:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951766.712070:0:15551:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783951766.712144:0:15551:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d50910000 00000020:00000080:1.0:1783951766.712147:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951766.712155:0:15551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951766.712158:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951766.712159:0:15551:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783951766.712162:0:15551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951766.712175:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951766.712177:0:15551:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783951766.712180:0:15551:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8d50910000 00000020:00000080:1.0:1783951766.712182:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951766.712274:0:15551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951766.712278:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951766.712279:0:15551:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783951766.712282:0:15551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951766.712284:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951766.712286:0:15551:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951766.712289:0:15551:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8d50910000 00000020:00000080:1.0:1783951766.712291:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951766.712333:0:15551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951766.712337:0:15551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951766.712338:0:15551:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783951766.712341:0:15551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1783951766.713383:0:15546:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783951766.713433:0:15546:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951766.713454:0:15546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.713467:0:15546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951766.713543:0:15546:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783951766.713546:0:15546:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8d50910000 10000000:01000000:0.0:1783951766.713557:0:15546:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8d50910000 10000000:01000000:0.0:1783951766.713562:0:15546:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951766.713567:0:15546:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e8d50910000 from 1 10000000:01000000:0.0:1783951766.713570:0:15546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951766.713608:0:15546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eed56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.713617:0:15546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eed56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.713628:0:15546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eed56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951766.713657:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951766.713750:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951766.713793:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951766.715449:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624351872 00000100:00100000:2.0:1783951766.715471:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624351872 00000100:00100000:2.0:1783951766.715526:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783951766.715535:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624351872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951766.715552:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951766.715568:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d75324e00/0x443dabd358eed573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed56c expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951766.715618:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75324e00/0x443dabd358eed573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed56c expref: 19 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951766.715631:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d75324e00/0x443dabd358eed573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed56c expref: 19 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951766.715641:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75324e00, rc 0) 00000100:00100000:2.0:1783951766.715718:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624351872:12345-0@lo:101:mount.lustre.0 Request processed in 183us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951766.715725:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783951766.715806:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624351872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951766.715841:0:15546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eed56c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed573 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951766.715851:0:15546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eed56c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed573 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951766.716773:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1783951766.717537:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951766.718337:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783951766.718400:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783951766.718639:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783951766.718800:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783951766.718869:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783951766.718922:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783951766.718960:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783951766.719363:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783951766.719843:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783951766.719889:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783951766.719918:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783951766.721579:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783951766.721713:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783951766.721755:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783951766.721846:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783951766.721885:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783951766.721920:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783951766.721982:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783951766.722025:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783951766.722086:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783951766.722387:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783951766.722454:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783951766.722505:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783951766.722558:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783951766.722596:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1783951766.722632:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1783951766.722695:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1783951766.722732:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1783951766.722769:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1783951766.722837:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1783951766.722874:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1783951766.722907:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1783951766.722940:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1783951766.723207:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1783951766.723255:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1783951766.723303:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1783951766.723338:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1783951766.723431:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1783951766.723439:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1783951766.723561:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951766.723632:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951766.723755:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624352000 00000100:00100000:1.0:1783951766.723763:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624352000 00000100:00100000:1.0:1783951766.723825:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783951766.723836:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951766.724079:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352000:12345-0@lo:501:mount.lustre.0 Request processed in 245us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951766.724087:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783951766.724218:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951766.724242:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951766.724274:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951766.724310:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951766.724333:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c43835e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951766.726623:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624352128 00000100:00100000:1.0:1783951766.726635:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624352128 00000100:00100000:1.0:1783951766.726681:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783951766.726798:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951766.727127:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352128:12345-0@lo:503:mount.lustre.0 Request processed in 331us (2814us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951766.727135:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783951766.727224:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352128:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951766.727760:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951766.727863:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951766.727912:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951766.727947:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d48198e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951766.728922:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624352256 00000100:00100000:1.0:1783951766.728931:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624352256 00000100:00100000:1.0:1783951766.728985:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783951766.728994:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951766.729342:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352256:12345-0@lo:502:mount.lustre.0 Request processed in 348us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951766.729350:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783951766.733276:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951766.733625:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783951766.733849:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783951766.733888:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783951766.733937:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783951766.734047:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783951766.734188:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783951766.734230:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783951766.734262:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783951766.734306:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783951766.734353:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783951766.734390:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783951766.734439:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783951766.734492:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783951766.734525:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783951766.734575:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783951766.734615:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783951766.734650:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783951766.735182:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783951766.735225:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783951766.735262:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783951766.735314:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783951766.735352:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783951766.735388:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783951766.735439:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783951766.735477:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1783951766.735514:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1783951766.735562:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1783951766.735598:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1783951766.735653:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1783951766.735901:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1783951766.735939:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1783951766.736031:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1783951766.736070:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1783951766.736209:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1783951766.736248:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1783951766.736307:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1783951766.736343:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1783951766.736376:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1783951766.736422:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1783951766.736460:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1783951766.736513:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951766.736608:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951766.736657:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624352384 00000100:00100000:1.0:1783951766.736665:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624352384 00000100:00100000:0.0:1783951766.736869:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d48198e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951766.736968:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783951766.736982:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951766.737245:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352384:12345-0@lo:502:mount.lustre.0 Request processed in 264us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951766.737253:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783951766.737458:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951766.737544:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783951766.737555:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1783951766.740156:0:15555:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783951766.740185:0:15555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e8d816619c0) 00000020:00000080:0.0:1783951766.740211:0:15555:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1783951766.740435:0:15555:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8d50910000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783951766.740440:0:15555:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8d50910000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783951766.740443:0:15555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8d50910000 3 00010000:00080000:0.0:1783951766.740474:0:15555:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8d504c4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1783951766.742104:0:15555:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1783951766.742229:0:15555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783951766.742266:0:15555:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783951766.742280:0:15555:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x443dabd358eed581 00000100:00080000:0.0:1783951766.742292:0:15555:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951766.742298:0:15555:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8d504c4000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1783951766.742344:0:15555:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d65af0e00 x1870608624352512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951766.742372:0:15555:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783951766.749139:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1870608624352512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951766.749233:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951766.749307:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951766.749312:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951766.749315:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951766.749318:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783951766.749380:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624352640:0@lo:400:kworker.0 00000100:00100000:2.0:1783951766.749402:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951766.749889:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624352768:0@lo:400:kworker.0 00000100:00100000:2.0:1783951766.749920:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951766.749956:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624352512 00000100:00100000:2.0:1783951766.749963:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624352512 00000100:00100000:2.0:1783951766.749989:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624352640 00000100:00100000:2.0:1783951766.749992:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624352640 00000100:00100000:2.0:1783951766.750024:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624352768 00000100:00100000:2.0:1783951766.750027:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624352768 00000100:00100000:2.0:1783951766.750055:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951766.750064:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624352640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951766.750114:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624352640:12345-0@lo:400:kworker.0 Request processed in 52us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951766.750122:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951766.750138:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951766.750145:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624352768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951766.750183:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624352768:12345-0@lo:400:kworker.0 Request processed in 39us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951766.750189:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951766.750199:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783951766.750205:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1870608624352512:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783951766.750231:0:14246:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:0.0:1783951766.750279:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x443dabd358eed588 00000004:00100000:0.0:1783951766.750295:0:14246:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783951766.750328:0:14246:0:(import.c:65:import_set_state_nolock()) ffff8e8d60bd6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951766.750375:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1870608624352512:12345-0@lo:38:llog_process_th.0 Request processed in 169us (1143us total) trans 0 rc 0/0 00000100:00080000:2.0:1783951766.752216:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783951766.752270:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d757a6a00 x1870608624352768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951766.752289:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624352768:0@lo:400:kworker.0 00010000:00080000:2.0:1783951766.752327:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d757a6d80 x1870608624352640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951766.752336:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624352640:0@lo:400:kworker.0 00010000:00080000:2.0:1783951766.752361:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8d65af0e00 x1870608624352512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951766.752370:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783951766.752378:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783951766.752385:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783951766.752391:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783951766.752400:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d504c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783951766.752406:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1870608624352512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951766.763205:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1783951766.763460:0:15555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1783951766.764282:0:15546:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783951766.764315:0:15546:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951766.764334:0:15546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eed56c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed573 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951766.764348:0:15546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5600/0x443dabd358eed56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed573 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783951766.764395:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783951766.764398:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783951766.764399:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951766.764400:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951766.764401:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951766.764402:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951766.764404:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951766.764406:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951766.764407:0:15546:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951766.764413:0:15546:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1783951766.764416:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951766.764418:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783951766.764419:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951766.764424:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951766.764426:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951766.764427:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951766.764428:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951766.764429:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951766.764430:0:15546:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951766.764464:0:15546:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783951766.764898:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352896:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951766.765040:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951766.765143:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d7592d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951766.768340:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624352896 00000100:00100000:0.0:1783951766.768357:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624352896 00000100:00100000:0.0:1783951766.768424:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951766.769849:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:15546:x1870608624352896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783951766.769892:0:14238:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783951766.769907:0:14238:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783951766.814110:0:14238:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783951766.814133:0:14238:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783951766.814345:0:14260:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951766.814350:0:14260:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951766.814371:0:14260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951766.814391:0:14260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed526 expref: 19 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951766.814399:0:14260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951766.814455:0:14260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eed526 expref: 19 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951766.814470:0:14260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eed526 expref: 19 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951766.814494:0:14260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14260:1870608624353024:0@lo:104: 00000100:00100000:2.0:1783951766.814765:0:14260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951766.814839:0:14260:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d6050bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951766.814900:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624353024 00000100:00100000:3.0:1783951766.814908:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624353024 00000100:00100000:3.0:1783951766.814957:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951766.814967:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:14260:x1870608624353024:12345-0@lo:104: 00010000:00010000:3.0:1783951766.814981:0:14227:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815048:0:14227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783951766.815055:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:14260:x1870608624353024:12345-0@lo:104: Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951766.815061:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783951766.815081:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951766.815087:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815095:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29200 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951766.815099:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815108:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951766.815115:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951766.815122:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783951766.815150:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815157:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951766.815245:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815252:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29200/0x443dabd358eed526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed52d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815281:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951766.815283:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951766.815285:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951766.815306:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624353152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951766.815335:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951766.815373:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624353152 00000100:00100000:3.0:1783951766.815377:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624353152 00010000:00010000:3.0:1783951766.815394:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed526 expref: 20 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951766.815428:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951766.815435:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+20:3313:x1870608624353152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951766.815446:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951766.815451:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed526 expref: 20 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815460:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eed526 expref: 20 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815475:0:14231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815483:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951766.815658:0:14231:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001308301s 00010000:00010000:3.0:1783951766.815663:0:14231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815681:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815688:0:14231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815695:0:14231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815701:0:14231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951766.815706:0:14231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815714:0:14231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815723:0:14231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815732:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951766.815763:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+20:3313:x1870608624353152:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951766.815770:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951766.815852:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624353152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951766.815894:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce5800/0x443dabd358eed52d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eed526 expref: 19 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951766.815905:0:14260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14260:1870608624353024:0@lo:104: 00010000:00010000:3.0:1783951766.815921:0:14260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815937:0:14260:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815943:0:14260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951766.815949:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d75325000/0x443dabd358eed58f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951766.839280:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:15546:x1870608624352896:12345-0@lo:253:mount.lustre.0 Request processed in 69433us (74230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951766.839293:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783951766.839574:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:15546:1870608624352896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783951766.839591:0:15546:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783951766.839604:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783951766.839606:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783951766.839607:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951766.839608:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951766.839609:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951766.839610:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951766.839612:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951766.839613:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951766.839615:0:15546:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783951766.839630:0:15546:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783951766.849393:0:15546:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951766.849681:0:15546:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783951766.849860:0:15546:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951766.849987:0:15546:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783951766.851611:0:15546:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783951766.851928:0:15546:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783951766.858131:0:15546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783951766.916790:0:15546:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783951766.916802:0:15546:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783951766.917000:0:15546:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783951766.917131:0:15546:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783951766.917159:0:15546:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783951766.917200:0:15546:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783951767.032417:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951767.802058:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951752/real 1783951752] req@ffff8e8d65af0700 x1870608624345984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951767.802092:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8d65af0700 x1870608624345984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951767.802102:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951752/real 1783951752] req@ffff8e8d65af3100 x1870608624346112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951767.802111:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8d65af3100 x1870608624346112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951767.802133:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d601c1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951767.802175:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951767.802197:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624345984:0@lo:8:kworker.0 00000100:00080000:0.0:1783951767.802203:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d606ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951767.802210:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:1.0:1783951767.803041:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951767.803046:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783951767.803049:0:477:0:(import.c:65:import_set_state_nolock()) ffff8e8d601c1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951767.803055:0:477:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1783951767.803060:0:477:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951767.803066:0:477:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8d601c1800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783951767.803087:0:477:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d811a5500 x1870608624353408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951767.803107:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951767.803111:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783951767.803113:0:477:0:(import.c:65:import_set_state_nolock()) ffff8e8d606ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951767.803116:0:477:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1783951767.803118:0:477:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951767.803122:0:477:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8d606ae000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1783951767.803133:0:477:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8d811a5f80 x1870608624353536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951767.803199:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624353664:0@lo:400:kworker.0 00000100:00100000:3.0:1783951767.803352:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3314:1870608624353280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951767.806314:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624346112:0@lo:8:kworker.0 00000100:00100000:0.0:1783951767.806375:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624353408:0@lo:8:kworker.0 00000100:00100000:3.0:1783951767.807746:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951767.808000:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624353280 00000100:00100000:1.0:1783951767.808009:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624353280 00000100:00100000:1.0:1783951767.808063:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951767.808075:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:3314:x1870608624353280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951767.808130:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:3314:x1870608624353280:12345-0@lo:400:kworker.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951767.808137:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951767.808187:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624353792:0@lo:400:kworker.0 00000100:00100000:1.0:1783951767.808335:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951767.808370:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624353920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951767.808414:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951767.808442:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624353792 00000100:00100000:1.0:1783951767.808447:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624353792 00000100:00100000:1.0:1783951767.808594:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624353920 00000100:00100000:1.0:1783951767.808598:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624353920 00000100:00100000:1.0:1783951767.808709:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951767.808717:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624353792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951767.808759:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624353792:12345-0@lo:400:kworker.0 Request processed in 43us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951767.808766:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951767.808780:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951767.808786:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624353920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951767.809026:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624353920:12345-0@lo:400:kworker.0 Request processed in 240us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951767.809032:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1783951767.809052:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951767.809075:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951767.809094:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624353664 00000100:00100000:1.0:1783951767.809097:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624353664 00000100:00100000:1.0:1783951767.809117:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951767.809123:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624353664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951767.809161:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870608624353664:12345-0@lo:400:kworker.0 Request processed in 38us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951767.809167:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783951767.809309:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3314:1870608624353280:0@lo:400:kworker.0 00010000:00080000:3.0:1783951767.809353:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d811a5c00 x1870608624353792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951767.809364:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624353792:0@lo:400:kworker.0 00010000:00080000:3.0:1783951767.809391:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d811a6680 x1870608624353920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951767.809409:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624353920:0@lo:400:kworker.0 00010000:00080000:1.0:1783951767.809722:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d811a5880 x1870608624353664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951767.809732:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870608624353664:0@lo:400:kworker.0 00000100:00100000:0.0:1783951767.821542:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951767.821617:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624353536:0@lo:8:kworker.0 00000100:00100000:0.0:1783951767.821658:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951767.821699:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624353408 00000100:00100000:0.0:1783951767.821707:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624353408 00000100:00100000:0.0:1783951767.821737:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624353536 00000100:00100000:0.0:1783951767.821740:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624353536 00000100:00100000:0.0:1783951767.821753:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951767.821763:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1870608624353408:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783951767.821847:0:14879:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1783951767.821884:0:14879:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eed596 00002000:00100000:0.0:1783951767.821899:0:14879:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e8d60bd5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783951767.821905:0:14879:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783951767.821908:0:14879:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783951767.822302:0:14879:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783951767.822335:0:14879:0:(import.c:65:import_set_state_nolock()) ffff8e8d60bd2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951767.822397:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1870608624353408:12345-0@lo:8:kworker.0 Request processed in 633us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951767.822406:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951767.822428:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951767.822433:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1870608624353536:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783951767.822462:0:14879:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1783951767.822482:0:14879:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x443dabd358eed59d 00002000:00100000:0.0:1783951767.822488:0:14879:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e8d60bd7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783951767.822492:0:14879:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783951767.822494:0:14879:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783951767.822709:0:14879:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783951767.822723:0:14879:0:(import.c:65:import_set_state_nolock()) ffff8e8d60bd3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951767.822755:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1870608624353536:12345-0@lo:8:kworker.0 Request processed in 322us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951767.822762:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783951767.822829:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d811a5f80 x1870608624353536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951767.822841:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951767.822849:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783951767.822857:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783951767.822863:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783951767.822866:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d606ae000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783951767.822884:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783951767.822889:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624353536:0@lo:8:kworker.0 00000004:00080000:0.0:1783951767.822956:0:14269:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1783951767.822974:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14269:1870608624354176:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783951767.823001:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951767.823014:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d605d0cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1783951767.823029:0:14268:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783951767.823425:0:14268:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 484728613622ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783951767.823449:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624354048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951767.823485:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951767.823516:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624354176 00000100:00100000:0.0:1783951767.823521:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624354176 00000100:00100000:0.0:1783951767.823557:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951767.823564:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14269:x1870608624354176:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783951767.825602:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624354048 00000100:00100000:3.0:1783951767.825614:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624354048 00000100:00100000:3.0:1783951767.825662:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951767.825672:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624354048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951767.825700:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951767.825783:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1870608624354048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951767.825803:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783951767.825881:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d65af3800 x1870608624354048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951767.825905:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624354048:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783951767.825976:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1783951767.827693:0:14879:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1783951767.827702:0:14879:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1783951767.827708:0:14879:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:1.0:1783951767.840088:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d811a5500 x1870608624353408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951767.840106:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951767.840118:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783951767.840136:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783951767.840143:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783951767.840156:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8d601c1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783951767.840175:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783951767.840181:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1870608624353408:0@lo:8:kworker.0 00002000:00010000:0.0:1783951767.840568:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.840578:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.840593:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.840597:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.840603:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.840622:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.840631:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.840639:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.841742:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951767.842332:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951767.842344:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.842357:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.842363:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.842374:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.842402:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.842409:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.842436:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.842438:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.842440:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.843061:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.843070:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843082:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.843087:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.843094:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843106:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843115:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843122:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843143:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951767.843712:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.843719:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843728:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.843731:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.843736:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843756:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843764:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843771:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.843789:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951767.844326:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.844334:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844344:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.844347:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.844353:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844362:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844370:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844388:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844396:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1783951767.844877:0:14266:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00002000:00010000:0.0:1783951767.844936:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.844942:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844951:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.844954:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.844959:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844970:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844978:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844986:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.844996:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1783951767.845371:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783951767.845378:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845386:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5e00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.845391:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845399:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845417:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845424:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed5ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845441:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783951767.845450:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845457:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.845460:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845469:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845479:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845485:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed5b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845497:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951767.845500:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845506:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.845508:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845515:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845536:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845544:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed5b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845555:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.845558:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845563:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.845566:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845572:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845579:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845584:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.845593:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.845595:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.845603:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783951767.845998:0:14267:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1783951767.846025:0:14267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14267:1870608624354432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783951767.846108:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951767.846162:0:14267:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71d6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951767.846189:0:14877:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783951767.846196:0:14877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1783951767.846429:0:14266:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 484751617681ns, next at 0ns, rc = 0 00010000:00010000:0.0:1783951767.849499:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951767.850464:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951767.850493:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624354304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951767.850571:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951767.852056:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624354304 00000100:00100000:3.0:1783951767.852068:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624354304 00000100:00100000:3.0:1783951767.852117:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951767.852126:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624354304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951767.852174:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951767.852570:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870608624354304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 443us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951767.852579:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783951767.852603:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951767.852645:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624354432 00000100:00100000:3.0:1783951767.852650:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624354432 00010000:00080000:1.0:1783951767.852754:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d8133ad80 x1870608624354304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951767.852789:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624354304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951767.853597:0:15599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951767.853606:0:15599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14267:x1870608624354432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783951767.857547:0:15599:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1783951767.857561:0:15599:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1783951767.857568:0:15599:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1783951767.860198:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.862007:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862030:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.862036:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.862044:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862062:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862075:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862083:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862110:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.862137:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.862143:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862162:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.862168:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862177:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862201:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862208:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed5c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.862608:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.862610:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.862612:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.866591:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.866604:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.866621:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.866626:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.866633:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.866647:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.866657:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.866665:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.866701:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951767.870748:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.870765:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.870797:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.870803:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.871288:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.871306:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.871318:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.871327:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.871404:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951767.874844:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.874859:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.874878:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.874889:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.874897:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.874922:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.874934:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.874940:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877331:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951767.877343:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877357:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.877362:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877374:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877401:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877409:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed5ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877456:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951767.877460:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877467:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.877469:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877477:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877494:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877500:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed5d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877511:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.877515:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877521:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.877524:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877531:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877540:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.877547:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.877549:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.877550:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951767.878494:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.878503:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878522:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.878527:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951767.878534:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878550:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878558:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878566:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878584:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.878596:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.878600:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878607:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.878611:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878619:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878642:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878649:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f30d9ea0/0x443dabd358eed5e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.878662:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.878664:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.878666:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951767.879188:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.879195:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879205:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.879208:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951767.879225:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879237:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879245:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879253:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879278:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.879288:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.879291:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879298:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324600 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.879301:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879309:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879321:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879328:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa8d28ba/0x443dabd358eed5ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879341:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.879343:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.879344:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951767.879722:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.879728:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879737:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.879746:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951767.879752:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879762:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879769:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879777:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879789:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.879797:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.879800:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879807:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.879839:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879847:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879857:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879874:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b854267/0x443dabd358eed5f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.879887:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.879889:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.879891:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951767.880299:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.880305:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880314:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.880317:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951767.880322:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880330:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880338:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880345:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880361:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.880368:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.880376:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880384:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.880387:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880395:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880406:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880412:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081fef38a/0x443dabd358eed5f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880426:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.880428:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.880429:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951767.880838:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.880844:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880853:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.880856:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951767.880861:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880882:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880890:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880897:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880911:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.880918:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.880922:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880929:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.880933:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880941:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880952:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880960:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eed5ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.880978:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.880979:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.880981:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951767.884229:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.884244:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.884262:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.884267:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951767.884275:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.884289:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.884300:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.884309:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.884334:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783951767.884785:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.884791:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.885285:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.885290:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951767.885296:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.885308:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.885318:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.885325:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.885337:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951767.885509:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951767.885517:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885538:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324a00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.885543:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885552:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885572:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885580:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8fb64a/0x443dabd358eed606 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885637:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951767.885642:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885649:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.885651:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885671:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885682:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885689:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051607a69/0x443dabd358eed60d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.885702:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.885704:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.885706:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951767.885764:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.885770:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.885779:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.885782:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951767.885786:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.885795:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.886131:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.886635:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.886693:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.886719:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951767.887578:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951767.887587:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.887596:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.887601:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.887609:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.887628:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.887660:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d717224e/0x443dabd358eed614 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.887682:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.887685:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.887687:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951767.889611:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783951767.889623:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.889638:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1783951767.889643:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.890372:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951767.890383:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed5dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.890726:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.891997:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.892025:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.892038:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.892046:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.892081:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.892095:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.892100:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.892108:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.892112:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.892121:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.892137:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.894014:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1568ea8/0x443dabd358eed61b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951767.894521:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.894530:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.894543:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.894547:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.894553:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.894566:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.894580:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.894587:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.894605:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.894616:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.894621:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.894629:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.894633:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.894641:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951767.895605:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.895614:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.895626:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.895630:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.895635:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.896340:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.896349:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed622 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.896373:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.896381:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.896383:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783951767.897385:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1783951767.897453:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.897456:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.897458:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.899019:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.899042:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.899051:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.899091:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.900356:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.900369:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900381:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.900386:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900396:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900420:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900428:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c959c6f/0x443dabd358eed629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900447:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.900449:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.900450:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.900694:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.900701:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900712:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.900717:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.900728:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900741:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900749:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900757:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900774:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.900785:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.900799:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.900805:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.904302:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.904336:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.904361:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.904385:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed630 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.904414:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.904417:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.904419:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.905040:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.905049:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905060:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.905065:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.905071:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905095:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905105:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905113:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905138:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951767.905601:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.905607:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905616:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.905619:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.905624:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905632:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905640:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905658:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.905672:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783951767.907671:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951767.907687:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.907700:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.907706:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.907717:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.907740:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.907748:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a53891f/0x443dabd358eed637 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.907771:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.907775:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.909383:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.909389:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.909399:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.909419:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.909426:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed63e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.909445:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.909447:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.909450:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.909457:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.909738:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.909745:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.909757:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.909762:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.909769:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951767.910355:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.910361:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.910371:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.910375:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.910379:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.910389:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.910397:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.910403:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.910429:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.911992:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912012:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912021:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912040:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783951767.912056:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951767.912063:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912072:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfdc00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.912078:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912087:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912108:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912116:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed64c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912154:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.912158:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912166:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.912169:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912178:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912188:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912194:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed645 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.912212:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.912214:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.912216:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.913268:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.914590:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.914604:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.914626:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.914631:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.914637:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.914650:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.914660:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.914667:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.914690:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.916350:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.916362:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.916384:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfca00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.916389:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.916399:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.916420:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.916427:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed653 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.916447:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.916448:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.916450:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.916588:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.916596:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.916608:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.916617:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.916624:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.916636:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.916645:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.916652:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.916673:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951767.917430:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.917437:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917448:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.917451:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.917456:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917467:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917475:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917488:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917506:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783951767.917518:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951767.917523:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917530:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.917534:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917542:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917554:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917561:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed65a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917576:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.917579:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917597:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.917600:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917606:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917616:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917622:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed661 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.917634:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.917636:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.917637:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.918026:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.918493:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.918500:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.918512:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.918516:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.918521:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.918531:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.918551:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.918558:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.918578:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.919372:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.919381:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.919390:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfce00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.919395:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.919414:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.919434:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.919442:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed668 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.919464:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.919466:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.919468:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.920306:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.920316:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920329:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.920333:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.920340:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920353:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920363:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920370:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920402:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951767.920412:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.920417:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920425:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfd200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.920428:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920437:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920449:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920455:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed66f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.920470:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.920472:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.920473:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.922334:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.922347:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922364:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.922369:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.922375:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922390:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922407:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922415:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922435:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.922448:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.922453:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922461:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.922465:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922476:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922492:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922499:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed676 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.922517:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.922524:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.922526:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.924515:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.924533:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924551:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.924565:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.924572:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924588:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924598:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924607:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924627:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951767.924638:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.924645:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924652:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.924656:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924665:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924720:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924739:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed67d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.924755:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.924757:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.924759:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.929041:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.929057:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929077:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.929081:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.929088:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929104:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929114:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929121:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929153:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951767.929686:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.929692:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929703:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.929706:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.929711:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929728:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929737:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929743:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.929761:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951767.930391:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951767.930399:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930408:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.930413:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930421:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930438:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930446:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed684 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930467:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.930471:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930485:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.930488:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930495:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930505:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930513:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed68b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.930526:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.930528:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.930530:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.931422:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.931776:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.931784:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951767.932444:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.932451:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.932466:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.932470:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.932477:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.932490:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.932499:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.932520:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.932544:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951767.933556:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.933561:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.933567:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933580:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933596:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933604:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933618:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.933625:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933632:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.933637:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933647:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933664:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933671:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d81b8d/0x443dabd358eed699 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.933691:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.933693:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.933700:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.933714:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951767.934514:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.934520:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.934532:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.934535:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.934540:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.934550:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.934558:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.934565:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.934588:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951767.935562:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951767.935570:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.935605:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfd000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.935610:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.935619:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.935633:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.935640:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0f2c40f/0x443dabd358eed692 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.935941:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.935947:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.935955:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfcc00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.935958:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.935966:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.935977:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.935996:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d026067/0x443dabd358eed6a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.936013:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.936015:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.936017:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.936418:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.936426:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.936439:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.936444:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.936451:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.936463:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.936471:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.936479:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.936506:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951767.937243:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951767.937250:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.937266:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5e00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.937269:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.937295:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.937313:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.937319:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fa74435/0x443dabd358eed6a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.937370:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.937372:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.937374:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.937692:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.937698:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.937708:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.937711:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.937717:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.937734:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.937741:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.937747:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.937767:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951767.938153:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.938159:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.938167:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.938170:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.938177:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.938190:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.938196:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb0a4eb9/0x443dabd358eed6ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.938212:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.938214:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.938215:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.938994:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.939351:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.939361:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.939380:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.939385:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.939390:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.939401:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.939410:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.939416:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.939442:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951767.940952:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951767.940961:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.940971:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.940976:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.940985:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.941012:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.941019:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c26f9448/0x443dabd358eed6b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.941040:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.941042:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.941043:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.941438:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.941446:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.941458:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.941462:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.941469:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.941482:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.941491:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.941508:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.941529:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951767.942188:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.942196:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.942206:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.942209:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.942213:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.942222:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.942606:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951767.942614:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.942622:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfd200 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951767.942626:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.942634:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.942649:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.942656:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b876fea4/0x443dabd358eed6bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951767.942675:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.942677:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951767.942678:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.942771:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.942779:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.944559:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951767.946492:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.946504:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946522:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.946527:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.946534:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946548:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946559:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946566:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946588:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951767.946602:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951767.946609:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946624:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.946630:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946640:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946658:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946666:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007253dd9c/0x443dabd358eed6c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946689:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.946693:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946699:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfda00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.946703:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946710:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946720:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946732:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022a0b1bd/0x443dabd358eed6ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.946747:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.946749:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.946751:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.947222:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.947228:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947237:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.947240:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.947246:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947255:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947263:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947270:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947286:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951767.947294:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.947303:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947311:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfde00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.947314:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947322:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947333:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947339:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f65b7f5a/0x443dabd358eed6d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947353:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.947354:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.947356:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.947732:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.947737:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947746:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.947749:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.947753:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947773:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947782:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947788:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947802:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951767.947830:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.947834:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947840:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfce00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.947844:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947852:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947863:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947870:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d658b7/0x443dabd358eed6d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.947891:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.947893:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.947894:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.948288:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.948294:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948303:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.948305:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.948309:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948318:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948325:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948332:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948347:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951767.948355:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.948359:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948379:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfca00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.948383:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948390:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948399:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948405:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bc70c0a/0x443dabd358eed6df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948418:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.948420:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.948421:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.948854:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.948860:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948868:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.948872:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.948877:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948886:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948899:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948905:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948926:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951767.948934:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951767.948937:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948943:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfdc00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951767.948946:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948952:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948963:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948970:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e1a3dac/0x443dabd358eed6e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.948986:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.948993:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951767.948994:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.949441:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.949448:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949458:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.949462:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.949467:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949476:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949484:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949491:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949517:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.949526:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.949529:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949536:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.949539:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949546:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949557:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949564:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8922864/0x443dabd358eed6ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.949579:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.949581:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.949582:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.950024:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.950031:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950039:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.950047:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.950051:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950060:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950067:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950073:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950086:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.950094:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.950098:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950105:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.950108:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950115:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950125:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950159:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d66610/0x443dabd358eed6f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950175:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.950177:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.950178:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.950556:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.950561:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950569:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.950572:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.950577:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950586:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950594:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950601:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950615:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951767.950621:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951767.950632:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950638:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce4c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951767.950641:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950648:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950659:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950666:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a12aa2b/0x443dabd358eed6fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.950680:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.950682:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.950684:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951767.951087:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.951093:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.951101:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.951104:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.951108:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.951124:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.951131:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.951137:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.951232:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951767.954300:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951767.954988:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.954997:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955016:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.955021:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.955028:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955044:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955054:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955072:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955087:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951767.955475:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.955482:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955490:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.955494:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.955498:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955507:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955516:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955523:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955531:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783951767.955918:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783951767.955924:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955939:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=484s v=(0 0) 00010000:00010000:0.0:1783951767.955942:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951767.955946:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955955:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955964:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955972:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951767.955980:0:14879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:0.0:1783951767.956138:0:14879:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1783951767.956252:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14269:x1870608624354176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 132685us (133246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951767.956263:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951767.956331:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14269:1870608624354176:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783951767.956346:0:14269:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1783951767.956391:0:14269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d65af0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14269:1870608624354560:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783951767.956425:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951767.956468:0:14269:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44b42240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951767.956493:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624354560 00000100:00100000:0.0:1783951767.956500:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624354560 00000100:00100000:0.0:1783951767.956538:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951767.956546:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14269:x1870608624354560:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783951767.956583:0:14877:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1783951767.957320:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783951767.957330:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957342:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ede00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.957348:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957359:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957380:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957387:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d7a8c13/0x443dabd358eed702 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957424:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951767.957428:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957435:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ecc00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.957438:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957445:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957454:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957461:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416012b5/0x443dabd358eed709 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957472:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951767.957476:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957483:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5eda00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.957485:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957503:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957513:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957520:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b08b2cab/0x443dabd358eed710 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957533:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951767.957537:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957543:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed000 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.957545:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957551:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957559:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957566:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc0f13d/0x443dabd358eed717 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.957587:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.957589:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.957590:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.957863:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951767.958364:0:15599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783951767.958372:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.958384:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1783951767.958388:0:15599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951767.958393:0:15599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.958404:0:15599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.958413:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.958420:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951767.958433:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783951767.958623:0:15599:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1783951767.958700:0:15599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14267:x1870608624354432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 105094us (112590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951767.958710:0:15599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951767.958763:0:14267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14267:1870608624354432:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783951767.958778:0:14267:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1783951767.958872:0:14267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14267:1870608624354688:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783951767.958907:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951767.958946:0:14267:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71d6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951767.958972:0:15599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624354688 00000100:00100000:3.0:1783951767.958978:0:15599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624354688 00000100:00100000:3.0:1783951767.959011:0:15599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951767.959019:0:15599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14267:x1870608624354688:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783951767.959053:0:15599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1783951767.961755:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951767.961767:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.961783:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfc800 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951767.961789:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.961800:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.961845:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.961853:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af42b48e/0x443dabd358eed71e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951767.961875:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.961877:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951767.961880:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783951767.962570:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783951767.973711:0:15599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14267:x1870608624354688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14686us (14797us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783951767.973725:0:15599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783951767.974005:0:14267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14267:1870608624354688:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783951767.974023:0:14267:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:0.0:1783951767.979748:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14269:x1870608624354560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23192us (23312us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783951767.979762:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951767.982463:0:14269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d65af0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14269:1870608624354560:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783951767.982483:0:14269:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1783951768.066255:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783951768.823177:0:14242:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783951768.823186:0:14242:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e8c43562000 from 8 10000000:01000000:3.0:1783951768.823191:0:14242:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783951768.823239:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfdc00/0x443dabd358eed725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951768.823249:0:14242:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfdc00/0x443dabd358eed725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951768.823258:0:14242:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfdc00/0x443dabd358eed725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951768.823282:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624354816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951768.823358:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951768.823404:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71d6a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951768.823502:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624354816 00000100:00100000:0.0:1783951768.823509:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624354816 00000100:00100000:0.0:1783951768.823565:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783951768.823576:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:14242:x1870608624354816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951768.823590:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951768.823601:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d6d5eca00/0x443dabd358eed72c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed725 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951768.823619:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d6d5eca00/0x443dabd358eed72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed725 expref: 19 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951768.823626:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d6d5eca00/0x443dabd358eed72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed725 expref: 19 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951768.823633:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5eca00, rc 0) 00000100:00100000:0.0:1783951768.823669:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:14242:x1870608624354816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951768.823674:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783951768.823759:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624354816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951768.823771:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfdc00/0x443dabd358eed725 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed72c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951768.823791:0:14242:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfdc00/0x443dabd358eed725 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed72c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951768.823876:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624354944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783951768.823900:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951768.823917:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71d6a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951768.824025:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624354944 00000100:00100000:2.0:1783951768.824033:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624354944 00000100:00100000:2.0:1783951768.824049:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783951768.824053:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:14242:x1870608624354944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783951768.824064:0:14239:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951768.824076:0:14239:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951768.824078:0:14239:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783951768.824148:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:14242:x1870608624354944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951768.824155:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783951768.824281:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624354944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783951768.824327:0:14242:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783951768.824341:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfdc00/0x443dabd358eed725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed72c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951768.824347:0:14242:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d76dfdc00/0x443dabd358eed725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed72c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951769.083730:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783951769.568982:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783951769.569018:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1783951770.103031:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951771.131528:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951772.151126:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783951772.154026:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1783951772.154086:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783951773.046072:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3312:1870608624355072:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.046144:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951773.046192:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624355584:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.046217:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951773.046239:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783951773.046245:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624355200:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.046268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951773.046285:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624355712:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.046303:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951773.046330:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624355328:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.046356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951773.046372:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951773.046378:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d811a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624355456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.046398:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951773.046699:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624355072 00000100:00100000:1.0:1783951773.046707:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624355072 00000100:00100000:1.0:1783951773.046753:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783951773.046762:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3312:x1870608624355072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.046835:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3312:x1870608624355072:12345-0@lo:400:kworker.0 Request processed in 74us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951773.046843:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783951773.046873:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624355584 00000100:00100000:1.0:1783951773.046877:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624355584 00000100:00100000:1.0:1783951773.046906:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624355712 00000100:00100000:1.0:1783951773.046909:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624355712 00000100:00100000:1.0:1783951773.046921:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624355456 00000100:00100000:1.0:1783951773.046924:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624355456 00000100:00100000:1.0:1783951773.046948:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951773.046954:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624355584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.046989:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624355584:12345-0@lo:400:kworker.0 Request processed in 35us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951773.046995:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951773.047010:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951773.047016:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624355712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.047220:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870608624355712:12345-0@lo:400:kworker.0 Request processed in 203us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951773.047227:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951773.047241:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951773.047246:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624355456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.047279:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624355456:12345-0@lo:400:kworker.0 Request processed in 33us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951773.047284:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951773.047310:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624355200 00000100:00100000:1.0:1783951773.047314:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624355200 00000100:00100000:1.0:1783951773.047347:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624355328 00000100:00100000:1.0:1783951773.047350:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624355328 00000100:00100000:1.0:1783951773.047372:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951773.047378:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624355200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.047411:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624355200:12345-0@lo:400:kworker.0 Request processed in 34us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951773.047417:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951773.047491:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951773.047499:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624355328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.047539:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624355328:12345-0@lo:400:kworker.0 Request processed in 42us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951773.047546:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783951773.047579:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951773.047583:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951773.047586:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783951773.047622:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d811a7100 x1870608624355456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951773.047636:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624355456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.047645:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783951773.047659:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624355328:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.047880:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783951773.047892:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624355200:0@lo:400:kworker.0 00010000:00080000:1.0:1783951773.047904:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d811a4000 x1870608624355712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951773.047913:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1870608624355712:0@lo:400:kworker.0 00000100:00100000:1.0:1783951773.047922:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3312:1870608624355072:0@lo:400:kworker.0 00010000:00080000:1.0:1783951773.047933:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8d811a4e00 x1870608624355584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951773.047940:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d811a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624355584:0@lo:400:kworker.0 00000100:00100000:2.0:1783951773.048196:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951773.048208:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624355840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951773.048245:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951773.048283:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624355840 00000100:00100000:2.0:1783951773.048287:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624355840 00000100:00100000:2.0:1783951773.048317:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951773.048324:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624355840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951773.048352:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951773.048389:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624355840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951773.048395:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951773.048443:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624355840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951773.050002:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624355968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951773.050073:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951773.050120:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624355968 00000100:00100000:2.0:1783951773.050127:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624355968 00000100:00100000:2.0:1783951773.050181:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951773.050191:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624355968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951773.050226:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951773.050269:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624355968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951773.050276:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951773.050360:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624355968:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951773.177316:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951773.542213:0:15905:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783951774.198016:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951774.530635:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783951775.222126:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951775.681586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951775.682638:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602341120 00000100:00100000:0.0:1783951775.682651:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602341120 00000100:00100000:0.0:1783951775.682717:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1783951775.682733:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1870608602341120:12345-192.168.201.6@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783951775.682763:0:14238:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 544b254b-942e-47b4-ac59-b6a7835a5897@192.168.201.6@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1783951775.682793:0:14238:0:(genops.c:1406:class_connect()) connect: client 544b254b-942e-47b4-ac59-b6a7835a5897, cookie 0x443dabd358eed733 00000100:00080000:0.0:1783951775.683101:0:14238:0:(import.c:65:import_set_state_nolock()) ffff8e8d60a1f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951775.683169:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+5:2357:x1870608602341120:12345-192.168.201.6@tcp:250:mount.lustre.0 Request processed in 435us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951775.683178:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:2.0:1783951775.685114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.685409:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602341248 00000100:00100000:1.0:1783951775.685432:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602341248 00000100:00100000:1.0:1783951775.685500:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:1.0:1783951775.685511:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+5:13711:x1870608602341248:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951775.685531:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951775.685551:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e28200/0x443dabd358eed73a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a0389d2 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.685580:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e28200/0x443dabd358eed73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389d2 expref: 6 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.685592:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e28200/0x443dabd358eed73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389d2 expref: 6 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.685601:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28200, rc 0) 00000100:00100000:1.0:1783951775.685662:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+6:13711:x1870608602341248:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 153us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.685669:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:2.0:1783951775.687468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.687605:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602341376 00000100:00100000:1.0:1783951775.687614:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602341376 00000100:00100000:1.0:1783951775.687701:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:1.0:1783951775.687722:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+6:13711:x1870608602341376:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783951775.688061:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+6:13711:x1870608602341376:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 350us (600us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783951775.688070:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:2.0:1783951775.692402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.692582:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602341504 00000100:00100000:1.0:1783951775.692593:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602341504 00000100:00100000:1.0:1783951775.692660:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:1.0:1783951775.692671:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+6:13711:x1870608602341504:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951775.692708:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951775.692731:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e28e00/0x443dabd358eed741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a0389d9 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.692763:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e28e00/0x443dabd358eed741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389d9 expref: 7 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.692775:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e28e00/0x443dabd358eed741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a0389d9 expref: 7 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.692785:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28e00, rc 0) 00000100:00100000:1.0:1783951775.693984:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+7:13711:x1870608602341504:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 1307us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.693994:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:2.0:1783951775.701781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.703128:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602341632 00000100:00100000:1.0:1783951775.703144:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602341632 00000100:00100000:1.0:1783951775.703217:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:1.0:1783951775.703228:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+7:13711:x1870608602341632:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783951775.704549:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+8:13711:x1870608602341632:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 581us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.704565:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:2.0:1783951775.707203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.708189:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602341760 00000100:00100000:1.0:1783951775.708202:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602341760 00000100:00100000:1.0:1783951775.708276:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:1.0:1783951775.708290:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+8:13711:x1870608602341760:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783951775.708588:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+8:13711:x1870608602341760:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 299us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.708604:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:2.0:1783951775.711963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.712042:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602341888 00000100:00100000:1.0:1783951775.712052:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602341888 00000100:00100000:1.0:1783951775.712117:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:1.0:1783951775.712129:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+8:13729:x1870608602341888:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951775.712532:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+8:13729:x1870608602341888:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 404us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.712541:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:2.0:1783951775.737904:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951775.738229:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602342016 00000100:00100000:0.0:1783951775.738241:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602342016 00000100:00100000:0.0:1783951775.738306:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:0.0:1783951775.738316:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+8:13729:x1870608602342016:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951775.738652:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+8:13729:x1870608602342016:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 336us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951775.738662:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:0.0:1783951775.747767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951775.748117:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602342144 00000100:00100000:2.0:1783951775.748128:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602342144 00000100:00100000:2.0:1783951775.748192:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:2.0:1783951775.748204:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+8:13711:x1870608602342144:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783951775.748227:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951775.748247:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d75325c00/0x443dabd358eed748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038a03 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951775.748279:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75325c00/0x443dabd358eed748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a03 expref: 9 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951775.748311:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d75325c00/0x443dabd358eed748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a03 expref: 9 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951775.748321:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325c00, rc 0) 00000100:00100000:2.0:1783951775.748387:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+9:13711:x1870608602342144:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 186us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951775.748394:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:2.0:1783951775.752374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.752478:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602342272 00000100:00100000:1.0:1783951775.752496:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602342272 00000100:00100000:1.0:1783951775.752557:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:1.0:1783951775.752568:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+9:13711:x1870608602342272:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783951775.752604:0:14239:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783951775.752633:0:14239:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783951775.752637:0:14239:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783951775.752640:0:14239:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783951775.752642:0:14239:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1783951775.759717:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+9:13711:x1870608602342272:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 7126us (7327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.759736:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:0.0:1783951775.763802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.763905:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602342400 00000100:00100000:1.0:1783951775.763912:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602342400 00000100:00100000:1.0:1783951775.763962:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:1.0:1783951775.763972:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+9:13711:x1870608602342400:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951775.763991:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951775.764033:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038a0a expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.764063:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.764073:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951775.764079:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29c00, rc 0) 00000100:00100000:1.0:1783951775.764127:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+10:13711:x1870608602342400:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 157us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.764135:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:2.0:1783951775.766381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.768043:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602342528 00000100:00100000:1.0:1783951775.768056:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602342528 00000100:00100000:1.0:1783951775.768111:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:1.0:1783951775.768121:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+10:13711:x1870608602342528:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783951775.768380:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+10:13711:x1870608602342528:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 259us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.768389:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:2.0:1783951775.772252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.772351:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602342656 00000100:00100000:1.0:1783951775.772360:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602342656 00000100:00100000:1.0:1783951775.772448:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:1.0:1783951775.772458:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d76dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+10:13711:x1870608602342656:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783951775.772695:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d76dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+10:13711:x1870608602342656:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 238us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.772703:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:0.0:1783951775.779553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.780122:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602342784 00000100:00100000:1.0:1783951775.780134:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602342784 00000100:00100000:1.0:1783951775.780190:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:1.0:1783951775.780197:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+10:13731:x1870608602342784:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951775.780458:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+10:13731:x1870608602342784:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 259us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.780466:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:0.0:1783951775.791279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.792744:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602342912 00000100:00100000:1.0:1783951775.792757:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602342912 00000100:00100000:1.0:1783951775.792893:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:1.0:1783951775.792905:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+10:13731:x1870608602342912:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951775.793211:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+10:13731:x1870608602342912:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 307us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.793219:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:3.0:1783951775.797586:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.798144:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602343040 00000100:00100000:1.0:1783951775.798155:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602343040 00000100:00100000:1.0:1783951775.798218:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1783951775.798227:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1870608602343040:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783951775.798271:0:14245:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0928eb69-1135-4771-83b7-3a40f8ba7584@192.168.201.6@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1783951775.798321:0:14245:0:(genops.c:1406:class_connect()) connect: client 0928eb69-1135-4771-83b7-3a40f8ba7584, cookie 0x443dabd358eed756 00000004:00100000:1.0:1783951775.798356:0:14245:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1783951775.798363:0:14245:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1783951775.846644:0:14245:0:(import.c:65:import_set_state_nolock()) ffff8e8c4296c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951775.846737:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2357:x1870608602343040:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 48507us (49158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951775.846751:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1783951775.850174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.850518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951775.850797:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602343168 00000100:00100000:2.0:1783951775.850827:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602343168 00000100:00100000:2.0:1783951775.850901:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602343296 00000100:00100000:2.0:1783951775.850904:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602343296 00000100:00100000:2.0:1783951775.850921:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1783951775.850930:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+7:0:x1870608602343168:12345-192.168.201.6@tcp:41:mount.lustre.0 00000100:00080000:1.0:1783951775.851035:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1783951775.851147:0:14246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783951775.851251:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+7:0:x1870608602343168:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 320us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951775.851260:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1783951775.851280:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1783951775.851287:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13711:x1870608602343296:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783951775.851313:0:14246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783951775.851339:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13711:x1870608602343296:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 52us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951775.851346:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1783951775.854767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951775.855903:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602343424 00000100:00100000:0.0:1783951775.855913:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602343424 00000100:00100000:0.0:1783951775.855970:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1783951775.855990:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13711:x1870608602343424:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783951775.856094:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13711:x1870608602343424:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 106us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951775.856102:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1783951775.860255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.860382:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602343808 00000100:00100000:1.0:1783951775.860393:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602343808 00000100:00100000:1.0:1783951775.860449:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783951775.860466:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13711:x1870608602343808:12345-192.168.201.6@tcp:33:mount.lustre.0 00000100:00100000:1.0:1783951775.864387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.864435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951775.864465:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602343552 00000100:00100000:1.0:1783951775.864476:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602343552 00000100:00100000:1.0:1783951775.864521:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602343680 00000100:00100000:1.0:1783951775.864525:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602343680 00000100:00100000:1.0:1783951775.864544:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1783951775.864552:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1870608602343552:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783951775.864582:0:14879:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0928eb69-1135-4771-83b7-3a40f8ba7584@192.168.201.6@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1783951775.864615:0:14879:0:(genops.c:1406:class_connect()) connect: client 0928eb69-1135-4771-83b7-3a40f8ba7584, cookie 0x443dabd358eed75d 00002000:00100000:1.0:1783951775.864627:0:14879:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0928eb69-1135-4771-83b7-3a40f8ba7584/ffff8e8d7faae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783951775.864652:0:14879:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951775.864989:0:14879:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783951775.865027:0:14879:0:(import.c:65:import_set_state_nolock()) ffff8e8d7faab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951775.865087:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2357:x1870608602343552:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 534us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.865093:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1783951775.865108:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783951775.865110:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1870608602343680:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783951775.865122:0:14879:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0928eb69-1135-4771-83b7-3a40f8ba7584@192.168.201.6@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1783951775.865134:0:14879:0:(genops.c:1406:class_connect()) connect: client 0928eb69-1135-4771-83b7-3a40f8ba7584, cookie 0x443dabd358eed764 00002000:00100000:1.0:1783951775.865144:0:14879:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0928eb69-1135-4771-83b7-3a40f8ba7584/ffff8e8d7faa9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783951775.865157:0:14879:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951775.865285:0:14879:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783951775.865297:0:14879:0:(import.c:65:import_set_state_nolock()) ffff8e8d5844e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951775.865315:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2357:x1870608602343680:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 203us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.865319:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000004:00080000:0.0:1783951775.865774:0:14247:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5220us 00000004:00200000:1.0:1783951775.874890:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1783951775.875082:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13711:x1870608602343808:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 14615us (14828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951775.875095:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783951776.011256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951776.011356:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602343936 00000100:00100000:3.0:1783951776.011366:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602343936 00000100:00100000:3.0:1783951776.011440:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1783951776.011451:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13752:x1870608602343936:12345-192.168.201.6@tcp:101:mkdir.0 00010000:00010000:3.0:1783951776.011472:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951776.011697:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed76b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038a34 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951776.011768:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed772 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951776.011800:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951776.011860:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951776.012097:0:14244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783951776.012102:0:14244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951776.012193:0:14244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951776.012221:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed76b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a34 expref: 8 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951776.012238:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a34 expref: 7 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951776.012246:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d46530200) 00010000:00010000:3.0:1783951776.012249:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951776.012252:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfce00, rc 0) 00000100:00100000:3.0:1783951776.012364:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+7:13752:x1870608602343936:12345-192.168.201.6@tcp:101:mkdir.0 Request processed in 913us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951776.012382:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:3.0:1783951776.246394:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783951777.215853:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0928eb69-1135-4771-83b7-3a40f8ba7584 00010000:00010000:1.0:1783951777.269977:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951778.025266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951778.025398:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602344064 00000100:00100000:2.0:1783951778.025407:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602344064 00000100:00100000:2.0:1783951778.025646:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1783951778.025657:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+7:13804:x1870608602344064:12345-192.168.201.6@tcp:41:lfs.0 00000004:00000024:2.0:1783951778.025733:0:14246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783951778.025852:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+7:13804:x1870608602344064:12345-192.168.201.6@tcp:41:lfs.0 Request processed in 195us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951778.025860:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:1.0:1783951778.029181:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951778.035167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951778.035305:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602344192 00000100:00100000:0.0:1783951778.035317:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602344192 00000100:00100000:0.0:1783951778.035391:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1783951778.035400:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13804:x1870608602344192:12345-192.168.201.6@tcp:13:lfs.0 00002000:00000024:0.0:1783951778.035439:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951778.035510:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0928eb69-1135-4771-83b7-3a40f8ba7584+6:13804:x1870608602344192:12345-192.168.201.6@tcp:13:lfs.0 Request processed in 111us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951778.035515:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00080000:1.0:1783951778.035575:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951778.038586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951778.038659:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602344320 00000100:00100000:0.0:1783951778.038669:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602344320 00000100:00100000:0.0:1783951778.038749:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1783951778.038760:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0928eb69-1135-4771-83b7-3a40f8ba7584+5:13804:x1870608602344320:12345-192.168.201.6@tcp:13:lfs.0 00002000:00000024:0.0:1783951778.038802:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951778.038915:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0928eb69-1135-4771-83b7-3a40f8ba7584+5:13804:x1870608602344320:12345-192.168.201.6@tcp:13:lfs.0 Request processed in 157us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951778.038923:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00080000:1.0:1783951778.039068:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951778.166218:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624356096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951778.166375:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951778.166716:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624356352:0@lo:400:kworker.0 00000100:00100000:2.0:1783951778.166752:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951778.166775:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951778.166780:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624356480:0@lo:400:kworker.0 00000100:00100000:2.0:1783951778.166806:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951778.166866:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624356480 00000100:00100000:2.0:1783951778.166873:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624356480 00000100:00100000:2.0:1783951778.166923:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951778.166935:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624356480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951778.166997:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624356480:12345-0@lo:400:kworker.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951778.167004:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951778.167062:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624356480:0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.167854:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624356224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.167902:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951778.167945:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624356736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.167985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951778.168008:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951778.168014:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624356608:0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.168037:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951778.168066:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624356736 00000100:00100000:0.0:1783951778.168071:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624356736 00000100:00100000:0.0:1783951778.168111:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624356608 00000100:00100000:0.0:1783951778.168113:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624356608 00000100:00100000:0.0:1783951778.168129:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951778.168135:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624356736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.168177:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624356736:12345-0@lo:400:kworker.0 Request processed in 41us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951778.168183:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951778.168196:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783951778.168202:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624356608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.168229:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624356608:12345-0@lo:400:kworker.0 Request processed in 27us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951778.168235:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783951778.168279:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624356608:0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.168302:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624356736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.168407:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624356096 00000100:00100000:0.0:1783951778.168411:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624356096 00000100:00100000:0.0:1783951778.168442:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783951778.168449:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d811a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624356096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951778.168466:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951778.168507:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d811a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624356096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951778.168515:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951778.168709:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951778.168721:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624356864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951778.168754:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951778.173571:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624356224 00000100:00100000:3.0:1783951778.173587:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624356224 00000100:00100000:3.0:1783951778.173656:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783951778.173667:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3313:x1870608624356224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951778.173774:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3313:x1870608624356224:12345-0@lo:400:kworker.0 Request processed in 110us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951778.173782:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783951778.174268:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624356352 00000100:00100000:1.0:1783951778.174274:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624356352 00000100:00100000:1.0:1783951778.174342:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951778.174351:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624356352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951778.174404:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624356352:12345-0@lo:400:kworker.0 Request processed in 56us (7652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.174411:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951778.174455:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624356352:0@lo:400:kworker.0 00000100:00080000:1.0:1783951778.174494:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951778.174498:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951778.174501:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951778.174534:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624356096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951778.177710:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d757a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624356224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951778.177760:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624356864 00000100:00100000:0.0:1783951778.177768:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624356864 00000100:00100000:0.0:1783951778.177875:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951778.177886:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624356864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951778.177913:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951778.178019:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624356864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (9264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951778.178027:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951778.178299:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624356864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951778.280231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951778.280477:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602344448 00000100:00100000:1.0:1783951778.280489:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602344448 00000100:00100000:1.0:1783951778.280548:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:1.0:1783951778.280559:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+10:13838:x1870608602344448:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951778.280577:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951778.280595:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e29a00/0x443dabd358eed779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038a3b expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.280627:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e29a00/0x443dabd358eed779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a3b expref: 11 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.280639:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e29a00/0x443dabd358eed779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a3b expref: 11 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.280649:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29a00, rc 0) 00000100:00100000:1.0:1783951778.280723:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+11:13838:x1870608602344448:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 166us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.280731:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:3.0:1783951778.291281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951778.294570:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602344576 00000100:00100000:2.0:1783951778.294590:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602344576 00000100:00100000:2.0:1783951778.294669:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:2.0:1783951778.294681:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+11:13838:x1870608602344576:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783951778.295178:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+11:13838:x1870608602344576:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 497us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951778.295187:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00010000:00010000:3.0:1783951778.300408:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951778.301803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951778.309382:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602344704 00000100:00100000:3.0:1783951778.309398:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602344704 00000100:00100000:2.0:1783951778.309692:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:2.0:1783951778.309705:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+11:13838:x1870608602344704:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783951778.310091:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+11:13838:x1870608602344704:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 389us (8299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951778.310100:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:3.0:1783951778.314112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951778.317162:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602344832 00000100:00100000:1.0:1783951778.317180:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602344832 00000100:00100000:1.0:1783951778.317328:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:1.0:1783951778.317342:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+11:13843:x1870608602344832:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951778.317778:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+11:13843:x1870608602344832:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 439us (3675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.317793:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:0.0:1783951778.350887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951778.351403:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602344960 00000100:00100000:3.0:1783951778.351414:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602344960 00000100:00100000:3.0:1783951778.351489:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:3.0:1783951778.351501:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+11:13843:x1870608602344960:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783951778.351800:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+11:13843:x1870608602344960:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 300us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951778.354959:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:3.0:1783951778.359484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951778.363325:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602345088 00000100:00100000:1.0:1783951778.363341:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602345088 00000100:00100000:1.0:1783951778.363646:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:1.0:1783951778.363658:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+11:13838:x1870608602345088:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951778.364074:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951778.364094:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e28000/0x443dabd358eed780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038a65 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.364126:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e28000/0x443dabd358eed780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a65 expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.364136:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e28000/0x443dabd358eed780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a65 expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.364146:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28000, rc 0) 00000100:00100000:1.0:1783951778.364221:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+12:13838:x1870608602345088:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 565us (4755us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.364229:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:0.0:1783951778.367361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951778.367426:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602345216 00000100:00100000:3.0:1783951778.367436:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602345216 00000100:00100000:3.0:1783951778.367598:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:3.0:1783951778.367610:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+12:13838:x1870608602345216:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783951778.367638:0:14237:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783951778.367772:0:14237:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783951778.367778:0:14237:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783951778.367782:0:14237:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783951778.367790:0:14237:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1783951778.369451:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+12:13838:x1870608602345216:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 1837us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951778.369463:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:0.0:1783951778.374880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951778.374992:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602345344 00000100:00100000:1.0:1783951778.375002:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602345344 00000100:00100000:1.0:1783951778.375125:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:1.0:1783951778.375137:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+12:13838:x1870608602345344:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951778.375156:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951778.375176:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038a6c expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.375226:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 13 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.375238:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 13 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951778.375249:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29200, rc 0) 00000100:00100000:1.0:1783951778.375313:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:13838:x1870608602345344:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 178us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.375320:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:0.0:1783951778.377926:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951778.378054:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602345472 00000100:00100000:3.0:1783951778.378063:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602345472 00000100:00100000:3.0:1783951778.378113:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:3.0:1783951778.378122:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+13:13838:x1870608602345472:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783951778.378407:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+13:13838:x1870608602345472:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 284us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951778.378415:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:0.0:1783951778.380602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951778.381039:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602345600 00000100:00100000:3.0:1783951778.381049:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602345600 00000100:00100000:3.0:1783951778.381112:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1783951778.381124:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+13:13838:x1870608602345600:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783951778.381520:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+13:13838:x1870608602345600:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 397us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951778.381538:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:0.0:1783951778.385568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951778.386286:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602345728 00000100:00100000:1.0:1783951778.386296:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602345728 00000100:00100000:1.0:1783951778.386353:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:1.0:1783951778.386364:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:13847:x1870608602345728:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951778.389385:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:13847:x1870608602345728:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 3010us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.389400:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:0.0:1783951778.395207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951778.395308:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602345856 00000100:00100000:2.0:1783951778.395318:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602345856 00000100:00100000:2.0:1783951778.395444:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:2.0:1783951778.395454:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+13:13847:x1870608602345856:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783951778.396144:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+13:13847:x1870608602345856:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 689us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951778.396153:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:0.0:1783951778.415523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951778.415586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951778.415618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951778.415652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951778.415696:0:15599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602346496 00000100:00100000:0.0:1783951778.415708:0:15599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602346496 00000100:00100000:0.0:1783951778.415774:0:15599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602346624 00000100:00100000:0.0:1783951778.415778:0:15599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602346624 00000100:00100000:3.0:1783951778.415784:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602345984 00000100:00100000:3.0:1783951778.415788:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602345984 00000100:00100000:0.0:1783951778.415804:0:15599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1783951778.415843:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602346368 00000100:00100000:3.0:1783951778.415847:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602346368 00000100:00100000:0.0:1783951778.415863:0:15599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2359:x1870608602346496:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951778.415868:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1783951778.415874:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+7:2359:x1870608602346368:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1783951778.415975:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1783951778.415986:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2359:x1870608602346624:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951778.416046:0:15599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2359:x1870608602346496:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 185us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951778.416055:0:15599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:2.0:1783951778.416365:0:14245:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783951778.416381:0:14245:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783951778.416495:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:2.0:1783951778.416502:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1870608602345984:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783951778.416536:0:14245:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 26878562-7460-4897-9435-927f340b8f45@192.168.201.6@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1783951778.416575:0:14245:0:(genops.c:1406:class_connect()) connect: client 26878562-7460-4897-9435-927f340b8f45, cookie 0x443dabd358eed78e 00000004:00100000:2.0:1783951778.416611:0:14245:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783951778.419262:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+7:2359:x1870608602346368:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 3374us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951778.419296:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1783951778.427747:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2359:x1870608602346624:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 11740us (12070us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.427764:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00080000:2.0:1783951778.428424:0:14245:0:(import.c:65:import_set_state_nolock()) ffff8e8c4296e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951778.428934:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26878562-7460-4897-9435-927f340b8f45+6:2357:x1870608602345984:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 12427us (13420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951778.428945:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1783951778.440348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951778.440457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951778.440662:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602346240 00000100:00100000:1.0:1783951778.440673:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602346240 00000100:00100000:1.0:1783951778.440761:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602346112 00000100:00100000:1.0:1783951778.440778:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602346112 00000100:00100000:1.0:1783951778.440805:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1783951778.440950:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+7:13838:x1870608602346240:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783951778.441013:0:14246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783951778.441090:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+7:13838:x1870608602346240:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 144us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.441099:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1783951778.441118:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:1.0:1783951778.441125:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+6:0:x1870608602346112:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783951778.441136:0:14246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783951778.441158:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+6:0:x1870608602346112:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.441164:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00080000:0.0:1783951778.441648:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951778.443862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951778.444005:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602346752 00000100:00100000:1.0:1783951778.444016:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602346752 00000100:00100000:1.0:1783951778.444086:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1783951778.444097:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+6:13838:x1870608602346752:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783951778.444189:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+6:13838:x1870608602346752:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 94us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.444197:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1783951778.452041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951778.452086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951778.452249:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602347136 00000100:00100000:3.0:1783951778.452259:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602347136 00000100:00100000:3.0:1783951778.452320:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1783951778.452331:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26878562-7460-4897-9435-927f340b8f45+6:13838:x1870608602347136:12345-192.168.201.6@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783951778.452713:0:14248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783951778.453235:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26878562-7460-4897-9435-927f340b8f45+6:13838:x1870608602347136:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 903us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951778.453244:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1783951778.454755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951778.462056:0:15599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602346880 00000100:00100000:2.0:1783951778.462072:0:15599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602346880 00000100:00100000:2.0:1783951778.462143:0:15599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602347008 00000100:00100000:2.0:1783951778.462146:0:15599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602347008 00000100:00100000:2.0:1783951778.462172:0:15599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1783951778.462180:0:15599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1870608602346880:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783951778.462219:0:15599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 26878562-7460-4897-9435-927f340b8f45@192.168.201.6@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1783951778.462254:0:15599:0:(genops.c:1406:class_connect()) connect: client 26878562-7460-4897-9435-927f340b8f45, cookie 0x443dabd358eed795 00002000:00100000:2.0:1783951778.462266:0:15599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 26878562-7460-4897-9435-927f340b8f45/ffff8e8c4296b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951778.462277:0:15599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783951778.462405:0:15599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783951778.462441:0:15599:0:(import.c:65:import_set_state_nolock()) ffff8e8c4296b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951778.462515:0:15599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26878562-7460-4897-9435-927f340b8f45+6:2357:x1870608602346880:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 333us (10427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951778.462523:0:15599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1783951778.466609:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1783951778.466624:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1870608602347008:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783951778.466670:0:14879:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 26878562-7460-4897-9435-927f340b8f45@192.168.201.6@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:1.0:1783951778.466712:0:14879:0:(genops.c:1406:class_connect()) connect: client 26878562-7460-4897-9435-927f340b8f45, cookie 0x443dabd358eed79c 00002000:00100000:1.0:1783951778.466755:0:14879:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 26878562-7460-4897-9435-927f340b8f45/ffff8e8d43211000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783951778.466767:0:14879:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951778.467086:0:14879:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783951778.467122:0:14879:0:(import.c:65:import_set_state_nolock()) ffff8e8d7a080000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951778.467211:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26878562-7460-4897-9435-927f340b8f45+6:2357:x1870608602347008:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 588us (12478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951778.467220:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:0.0:1783951778.624094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951778.624288:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602347264 00000100:00100000:2.0:1783951778.624311:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602347264 00000100:00100000:2.0:1783951778.624394:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1783951778.624413:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26878562-7460-4897-9435-927f340b8f45+6:13868:x1870608602347264:12345-192.168.201.6@tcp:101:mkdir.0 00010000:00010000:2.0:1783951778.624436:0:16023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951778.624460:0:16023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eed7a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038a96 expref: -99 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951778.624540:0:16023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951778.624556:0:16023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951778.624569:0:16023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951778.625178:0:16023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783951778.625184:0:16023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951778.625273:0:16023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951778.625309:0:16023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eed7a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 8 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951778.625327:0:16023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 7 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951778.625336:0:16023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d46530200) 00010000:00010000:2.0:1783951778.625339:0:16023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951778.625343:0:16023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75324600, rc 0) 00000100:00100000:2.0:1783951778.627208:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26878562-7460-4897-9435-927f340b8f45+7:13868:x1870608602347264:12345-192.168.201.6@tcp:101:mkdir.0 Request processed in 2795us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951778.627222:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00010000:00010000:2.0:1783951779.320193:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783951779.772015:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0928eb69-1135-4771-83b7-3a40f8ba7584 00000001:00100000:0.0:1783951779.772033:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26878562-7460-4897-9435-927f340b8f45 00010000:00010000:3.0:1783951780.344170:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783951781.301968:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 26878562-7460-4897-9435-927f340b8f45 00000001:00100000:0.0:1783951781.302113:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0928eb69-1135-4771-83b7-3a40f8ba7584 00010000:00010000:0.0:1783951781.366679:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951781.395607:0:16112:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1783951782.320699:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 26878562-7460-4897-9435-927f340b8f45 00010000:00010000:3.0:1783951782.390353:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951783.286102:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624356992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951783.286184:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951783.286433:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624356992 00000100:00100000:0.0:1783951783.286442:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624356992 00000100:00100000:0.0:1783951783.286503:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951783.286513:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624356992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951783.286553:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783951783.286613:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624356992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951783.286621:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951783.286857:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624357248:0@lo:400:kworker.0 00000100:00100000:3.0:1783951783.286907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951783.286934:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783951783.286940:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624357120:0@lo:400:kworker.0 00000100:00100000:3.0:1783951783.286968:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951783.286987:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624357632:0@lo:400:kworker.0 00000100:00100000:3.0:1783951783.287011:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783951783.287090:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951783.287103:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624357376:0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287143:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951783.287171:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951783.287177:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624357504:0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287198:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951783.287225:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624357248 00000100:00100000:1.0:1783951783.287229:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624357248 00000100:00100000:1.0:1783951783.287266:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951783.287272:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624357248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287311:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624357248:12345-0@lo:400:kworker.0 Request processed in 39us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951783.287318:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951783.287337:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624357120 00000100:00100000:1.0:1783951783.287340:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624357120 00000100:00100000:1.0:1783951783.287366:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783951783.287372:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3313:x1870608624357120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287400:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3313:x1870608624357120:12345-0@lo:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951783.287415:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783951783.287442:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624357632 00000100:00100000:1.0:1783951783.287446:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624357632 00000100:00100000:1.0:1783951783.287470:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624357376 00000100:00100000:1.0:1783951783.287473:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624357376 00000100:00100000:1.0:1783951783.287484:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624357504 00000100:00100000:1.0:1783951783.287487:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624357504 00000100:00100000:1.0:1783951783.287500:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951783.287505:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624357632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287535:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870608624357632:12345-0@lo:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951783.287541:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951783.287552:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951783.287557:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624357376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287726:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870608624357376:12345-0@lo:400:kworker.0 Request processed in 168us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951783.287733:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951783.287745:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951783.287751:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624357504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287777:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870608624357504:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951783.287782:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1783951783.287836:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951783.287840:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951783.287868:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1870608624357504:0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287879:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870608624357376:0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287928:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624357120:0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287938:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1870608624357632:0@lo:400:kworker.0 00000100:00100000:1.0:1783951783.287947:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624357248:0@lo:400:kworker.0 00000100:00100000:2.0:1783951783.288146:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624356992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951783.289716:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624357760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951783.289800:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951783.291424:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624357760 00000100:00100000:2.0:1783951783.291435:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624357760 00000100:00100000:2.0:1783951783.291510:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951783.291521:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624357760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951783.291563:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951783.291903:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624357760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 384us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951783.291911:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951783.293629:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624357760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783951783.414338:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951783.772196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951783.772232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951783.772259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951783.772277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951783.772293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951783.772320:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602347520 00000100:00100000:0.0:1783951783.772320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951783.772331:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602347520 00000100:00100000:0.0:1783951783.772339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951783.772359:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602347648 00000100:00100000:0.0:1783951783.772363:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602347648 00000100:00100000:0.0:1783951783.772387:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602347776 00000100:00100000:2.0:1783951783.772388:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602347904 00000100:00100000:2.0:1783951783.772390:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602347904 00000100:00100000:0.0:1783951783.772390:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602347776 00000100:00100000:0.0:1783951783.772402:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602348032 00000100:00100000:0.0:1783951783.772404:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602348032 00000100:00100000:2.0:1783951783.772411:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1783951783.772415:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602348160 00000100:00100000:0.0:1783951783.772417:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602348160 00000100:00100000:2.0:1783951783.772421:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2361:x1870608602347520:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951783.772432:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1783951783.772437:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2361:x1870608602347648:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951783.772501:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2361:x1870608602347648:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 62us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951783.772508:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1783951783.772527:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1783951783.772534:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2361:x1870608602347776:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951783.772855:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602347392 00000100:00100000:3.0:1783951783.772870:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602347392 00000100:00100000:3.0:1783951783.772912:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:3.0:1783951783.772919:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+13:2361:x1870608602347392:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951783.773045:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2361:x1870608602347520:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 623us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951783.773052:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:2.0:1783951783.773068:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1783951783.773074:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+6:2361:x1870608602347904:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951783.773188:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+6:2361:x1870608602347904:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 114us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951783.773195:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00080000:2.0:1783951783.773214:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951783.773218:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951783.773220:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951783.774028:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1783951783.774040:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26878562-7460-4897-9435-927f340b8f45+5:2361:x1870608602348032:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951783.774090:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26878562-7460-4897-9435-927f340b8f45+5:2361:x1870608602348032:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 53us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951783.774098:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1783951783.774692:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1783951783.774703:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26878562-7460-4897-9435-927f340b8f45+5:2361:x1870608602348160:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1783951783.774743:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26878562-7460-4897-9435-927f340b8f45+5:2361:x1870608602348160:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 44us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951783.774750:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1783951783.776717:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2361:x1870608602347776:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 4170us (4425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951783.776732:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1783951783.782789:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+13:2361:x1870608602347392:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 9837us (10569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951783.782853:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 103 00010000:00010000:3.0:1783951784.439078:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951784.761325:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1783951784.889304:0:16261:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8a085f10 20000000:00000080:1.0:1783951784.889329:0:16261:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8d5dae6000 uarg=0000000000000000 20000000:01000000:0.0:1783951784.891673:0:16261:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783951784.891683:0:16261:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783951784.891688:0:16261:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783951784.892776:0:16262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1783951784.893032:0:16261:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783951784.900996:0:16261:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783951784.901104:0:16261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901127:0:16261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 18 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901135:0:16261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed4ee expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901142:0:16261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed55e expref: 18 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901152:0:16261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901174:0:16261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901182:0:16261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901230:0:16261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901247:0:16261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 12 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951784.901262:0:16261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624357888:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951784.901696:0:16261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901707:0:16261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 12 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951784.901715:0:16261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624358016:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951784.901753:0:16261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eed55e expref: 18 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901762:0:16261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eed55e expref: 18 pid: 14237 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951784.901771:0:16261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624358144:0@lo:104: 00000100:00100000:1.0:1783951784.901866:0:16261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951784.901932:0:16261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eed4ee expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901941:0:16261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eed4ee expref: 18 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951784.901948:0:16261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624358272:0@lo:104: 00000100:00100000:1.0:1783951784.901969:0:16261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951784.901988:0:16261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 18 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951784.901996:0:16261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 18 pid: 14239 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951784.902004:0:16261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624358400:0@lo:104: 00000100:00100000:1.0:1783951784.902042:0:16261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951784.902052:0:16261:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aa000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951784.902148:0:14227:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783951784.902164:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624358144 00000100:00100000:3.0:1783951784.902173:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624358144 00000100:00100000:3.0:1783951784.902226:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624358272 00000100:00100000:3.0:1783951784.902229:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624358272 00000100:00100000:3.0:1783951784.902238:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624358400 00000100:00100000:3.0:1783951784.902241:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624358400 00000100:00100000:3.0:1783951784.902254:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951784.902263:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+5:16261:x1870608624358144:12345-0@lo:104: 00010000:00010000:3.0:1783951784.902278:0:14227:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902373:0:14227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783951784.902379:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+5:16261:x1870608624358144:12345-0@lo:104: Request processed in 117us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951784.902386:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951784.902405:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951784.902410:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+4:16261:x1870608624358272:12345-0@lo:104: 00010000:00010000:3.0:1783951784.902418:0:14227:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902451:0:14227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783951784.902455:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+4:16261:x1870608624358272:12345-0@lo:104: Request processed in 46us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951784.902462:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951784.902473:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951784.902606:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d75c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:16261:x1870608624358400:12345-0@lo:104: 00010000:00010000:3.0:1783951784.902615:0:14227:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902652:0:14227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783951784.902658:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d75c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+3:16261:x1870608624358400:12345-0@lo:104: Request processed in 179us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951784.902664:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783951784.902707:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783951784.902713:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902721:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d65ce5000 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951784.902725:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902735:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951784.902742:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951784.902749:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783951784.902782:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902789:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951784.902847:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902866:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d65ce5000/0x443dabd358eed55e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed565 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902893:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951784.902897:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902902:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324400 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951784.902906:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902913:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951784.902920:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951784.902925:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783951784.902937:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902942:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951784.902948:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902953:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d75324400/0x443dabd358eed4ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed4f5 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902961:0:14233:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951784.902964:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902979:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29600 already unused, calling callback (ffffffffc1d34c20) 10000000:00010000:3.0:1783951784.902982:0:14233:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.902988:0:14233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951784.902995:0:14233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951784.903000:0:14233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783951784.903011:0:14233:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.903017:0:14233:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951784.903031:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.903037:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29600/0x443dabd358eed4a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x443dabd358eed4a8 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.903051:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951784.903052:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951784.903054:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951784.903078:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8133b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3314:1870608624358528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951784.903110:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951784.903141:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951784.903147:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3314:1870608624358656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951784.903176:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951784.903195:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951784.903202:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624358784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951784.903240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951784.903268:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624358528 00000100:00100000:3.0:1783951784.903273:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624358528 00010000:00010000:3.0:1783951784.903297:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed55e expref: 19 pid: 14237 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951784.903315:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624358656 00000100:00100000:3.0:1783951784.903318:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624358656 00010000:00010000:3.0:1783951784.903328:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed4ee expref: 20 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951784.903337:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624358784 00000100:00100000:3.0:1783951784.903340:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624358784 00010000:00010000:3.0:1783951784.903349:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 21 pid: 14239 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951784.903360:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951784.903655:0:16261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624358144:0@lo:104: 00000100:00100000:1.0:1783951784.903667:0:16261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624358272:0@lo:104: 00000100:00100000:1.0:1783951784.903675:0:16261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624358400:0@lo:104: 00000100:00100000:3.0:1783951784.903969:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+21:3314:x1870608624358528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951784.903983:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951784.903990:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed55e expref: 21 pid: 14237 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904001:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eed55e expref: 21 pid: 14237 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904084:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d65ce4800/0x443dabd358eed565 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eed55e expref: 21 pid: 14237 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904117:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951784.904171:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+20:3314:x1870608624358528:12345-0@lo:103:ldlm_bl.0 Request processed in 803us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951784.904179:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951784.904200:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951784.904206:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3314:x1870608624358656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951784.904214:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951784.904218:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed4ee expref: 19 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904226:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eed4ee expref: 19 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904234:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d75325600/0x443dabd358eed4f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eed4ee expref: 19 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904243:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951784.904265:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:3314:x1870608624358656:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951784.904272:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951784.904284:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951784.904292:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d750b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:3313:x1870608624358784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951784.904299:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951784.904304:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 17 pid: 14239 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904312:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 17 pid: 14239 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904330:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d75324c00/0x443dabd358eed4a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x443dabd358eed4a1 expref: 17 pid: 14239 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.904338:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951784.904650:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3314:1870608624358656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951784.904660:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8133b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3314:1870608624358528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951784.904757:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d750b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:3313:x1870608624358784:12345-0@lo:103:ldlm_bl.0 Request processed in 466us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951784.904764:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1783951784.905401:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951784.907270:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3313:1870608624358784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951784.911572:0:16261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624357888:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951784.911591:0:16261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16261:1870608624358016:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951784.911638:0:16261:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951784.914939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951784.915404:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602348288 00000100:00100000:3.0:1783951784.915415:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602348288 00010000:00010000:3.0:1783951784.915460:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 13 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951784.915669:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1783951784.915679:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:544b254b-942e-47b4-ac59-b6a7835a5897+13:2359:x1870608602348288:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951784.915695:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951784.915702:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 13 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.915715:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 13 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.915737:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a6c expref: 13 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.915757:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951784.916196:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:544b254b-942e-47b4-ac59-b6a7835a5897+12:2359:x1870608602348288:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 515us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951784.916206:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:2.0:1783951784.919913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951784.920022:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602348416 00000100:00100000:3.0:1783951784.920033:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602348416 00010000:00010000:3.0:1783951784.920075:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 12 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951784.920113:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1783951784.920123:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:544b254b-942e-47b4-ac59-b6a7835a5897+12:2359:x1870608602348416:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951784.920139:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951784.920145:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 12 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920159:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 12 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920178:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d42e29c00/0x443dabd358eed74f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a0a expref: 12 pid: 14238 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920197:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920206:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920224:0:14230:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920231:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920238:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920264:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920271:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29e00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951784.920274:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920283:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920297:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951784.920308:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951784.920388:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:544b254b-942e-47b4-ac59-b6a7835a5897+11:2359:x1870608602348416:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 264us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951784.920397:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:2.0:1783951784.921509:0:16261:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951784.921522:0:16261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951784.921528:0:16261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8d42e29e00/0x443dabd358eed7b1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951785.470935:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951786.081401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951786.083937:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602348544 00000100:00100000:0.0:1783951786.083954:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602348544 00000100:00100000:0.0:1783951786.084027:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:0.0:1783951786.084049:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+11:13725:x1870608602348544:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951786.084069:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951786.084089:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d6d5ec400/0x443dabd358eed7b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038a9d expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.084131:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d6d5ec400/0x443dabd358eed7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a9d expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.084142:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d6d5ec400/0x443dabd358eed7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a9d expref: 12 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.084152:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ec400, rc 0) 00000100:00100000:0.0:1783951786.084219:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+12:13725:x1870608602348544:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 173us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951786.084227:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:1.0:1783951786.087279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951786.087732:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602348672 00000100:00100000:3.0:1783951786.087742:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602348672 00000100:00100000:3.0:1783951786.087800:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:3.0:1783951786.087852:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+12:13725:x1870608602348672:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951786.088149:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+12:13725:x1870608602348672:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 338us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951786.088158:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:2.0:1783951786.105469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951786.107259:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602348800 00000100:00100000:0.0:1783951786.107274:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602348800 00000100:00100000:0.0:1783951786.107332:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:0.0:1783951786.107343:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+12:13725:x1870608602348800:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.107574:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:544b254b-942e-47b4-ac59-b6a7835a5897+12:13725:x1870608602348800:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 232us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951786.107582:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:3.0:1783951786.124355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951786.125100:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602348928 00000100:00100000:2.0:1783951786.125112:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602348928 00000100:00100000:2.0:1783951786.125185:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:2.0:1783951786.125195:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+12:13725:x1870608602348928:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951786.125212:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951786.125232:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d75324000/0x443dabd358eed7bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x736c4e45a038aa4 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951786.125270:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d75324000/0x443dabd358eed7bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038aa4 expref: 13 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951786.125282:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d75324000/0x443dabd358eed7bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038aa4 expref: 13 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951786.125291:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75324000, rc 0) 00000100:00100000:2.0:1783951786.125356:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+13:13725:x1870608602348928:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 163us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951786.125363:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:0.0:1783951786.129262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951786.129536:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602349056 00000100:00100000:2.0:1783951786.129547:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602349056 00000100:00100000:2.0:1783951786.129609:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:2.0:1783951786.129620:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:13725:x1870608602349056:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951786.129973:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:13725:x1870608602349056:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 353us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951786.129992:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:3.0:1783951786.132154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951786.132786:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602349184 00000100:00100000:0.0:1783951786.132795:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602349184 00000100:00100000:0.0:1783951786.132863:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:0.0:1783951786.132873:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+13:13725:x1870608602349184:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.133095:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:544b254b-942e-47b4-ac59-b6a7835a5897+13:13725:x1870608602349184:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 223us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951786.133103:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 109 00010000:00010000:2.0:1783951786.486053:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783951786.813736:0:14242:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783951786.813744:0:14242:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d50910000 from 10 10000000:01000000:0.0:1783951786.813750:0:14242:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951786.813832:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d6d5ecc00/0x443dabd358eed7c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.813849:0:14242:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d6d5ecc00/0x443dabd358eed7c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.813862:0:14242:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d6d5ecc00/0x443dabd358eed7c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951786.813893:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624358912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.813974:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951786.814027:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c4205c780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951786.814052:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624358912 00000100:00100000:0.0:1783951786.814060:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624358912 00000100:00100000:0.0:1783951786.814884:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783951786.814896:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+16:14242:x1870608624358912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951786.814911:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951786.814925:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d6d5eda00/0x443dabd358eed7cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed7c6 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.814952:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d6d5eda00/0x443dabd358eed7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed7c6 expref: 17 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.814974:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d6d5eda00/0x443dabd358eed7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed7c6 expref: 17 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.814984:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5eda00, rc 0) 00000100:00100000:0.0:1783951786.815040:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:14242:x1870608624358912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951786.815047:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783951786.815878:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624358912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951786.815901:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d6d5ecc00/0x443dabd358eed7c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7cd expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.815912:0:14242:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d6d5ecc00/0x443dabd358eed7c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed7cd expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951786.815983:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.816026:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951786.816061:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c4205c780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951786.816080:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624359040 00000100:00100000:0.0:1783951786.816085:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624359040 00000100:00100000:0.0:1783951786.817234:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783951786.817245:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:14242:x1870608624359040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.817507:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:14242:x1870608624359040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951786.817514:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783951786.819765:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.820242:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.820307:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951786.821898:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8c4205c780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951786.828788:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624359168 00000100:00100000:2.0:1783951786.828804:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624359168 00000100:00100000:2.0:1783951786.828890:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783951786.828902:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:14242:x1870608624359168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951786.829410:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:14242:x1870608624359168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 509us (9101us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951786.829420:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783951786.829539:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951786.832390:0:16347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783951786.834304:0:14242:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783951786.834356:0:14242:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951786.834371:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d6d5ecc00/0x443dabd358eed7c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7cd expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951786.834386:0:14242:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d6d5ecc00/0x443dabd358eed7c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7cd expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951786.834400:0:14242:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951786.834404:0:14242:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8d79d96800 from 10 10000000:01000000:1.0:1783951786.834408:0:14242:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951786.834457:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29e00/0x443dabd358eed7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951786.834467:0:14242:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29e00/0x443dabd358eed7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951786.834479:0:14242:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29e00/0x443dabd358eed7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951786.834512:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951786.834609:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951786.834673:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aa000 going to sleep for 11 seconds 00000100:00100000:1.0:1783951786.834702:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624359296 00000100:00100000:1.0:1783951786.834709:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624359296 00000100:00100000:1.0:1783951786.834759:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783951786.834768:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+17:14242:x1870608624359296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951786.834991:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951786.835003:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed7db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed7d4 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951786.835025:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed7d4 expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951786.835034:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d42e29200/0x443dabd358eed7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed7d4 expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951786.835042:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29200, rc 0) 00000100:00100000:1.0:1783951786.835079:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:14242:x1870608624359296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951786.835086:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783951786.835148:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951786.835163:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29e00/0x443dabd358eed7d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7db expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951786.835174:0:14242:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29e00/0x443dabd358eed7d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed7db expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951786.835229:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951786.835255:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951786.835276:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aa000 going to sleep for 11 seconds 00000100:00100000:1.0:1783951786.835290:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624359424 00000100:00100000:1.0:1783951786.835294:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624359424 00000100:00100000:1.0:1783951786.835317:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783951786.835337:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d58466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:14242:x1870608624359424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951786.835617:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d58466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:14242:x1870608624359424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951786.835638:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783951786.835669:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951786.835696:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951786.835730:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951786.835741:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aa000 going to sleep for 11 seconds 00000100:00100000:1.0:1783951786.835751:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624359552 00000100:00100000:1.0:1783951786.835755:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624359552 00000100:00100000:1.0:1783951786.835790:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783951786.835797:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:14242:x1870608624359552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951786.835961:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:14242:x1870608624359552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951786.835968:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783951786.836005:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951786.843191:0:16348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1783951786.847868:0:14242:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1783951786.847907:0:14242:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951786.847919:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29e00/0x443dabd358eed7d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7db expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951786.847932:0:14242:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d42e29e00/0x443dabd358eed7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7db expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951786.847944:0:14242:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783951786.847947:0:14242:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e8c43562000 from 10 10000000:01000000:2.0:1783951786.847950:0:14242:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951786.847988:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d75324200/0x443dabd358eed7e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951786.847996:0:14242:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff8e8d75324200/0x443dabd358eed7e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951786.848020:0:14242:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff8e8d75324200/0x443dabd358eed7e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951786.848049:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81006680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951786.848237:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951786.848288:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951786.848492:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624359680 00000100:00100000:0.0:1783951786.848499:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624359680 00000100:00100000:0.0:1783951786.848553:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783951786.848563:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+18:14242:x1870608624359680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951786.848579:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951786.848593:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8d6d5ed000/0x443dabd358eed7e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x443dabd358eed7e2 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.848618:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8d6d5ed000/0x443dabd358eed7e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x443dabd358eed7e2 expref: 19 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.849380:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8d6d5ed000/0x443dabd358eed7e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x443dabd358eed7e2 expref: 19 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951786.849391:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ed000, rc 0) 00000100:00100000:0.0:1783951786.849451:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:14242:x1870608624359680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 890us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951786.849460:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783951786.849545:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81006680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951786.849564:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff8e8d75324200/0x443dabd358eed7e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7e9 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951786.849574:0:14242:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff8e8d75324200/0x443dabd358eed7e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x443dabd358eed7e9 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951786.849909:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81006680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951786.849944:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951786.850006:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951786.857058:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624359808 00000100:00100000:3.0:1783951786.857072:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624359808 00000100:00100000:3.0:1783951786.857426:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783951786.857440:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:14242:x1870608624359808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951786.858437:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:14242:x1870608624359808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 998us (8486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951786.858449:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783951786.865596:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81006680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951786.866175:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81006680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951786.866254:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951786.866297:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71de2840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951786.866297:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624359936 00000100:00100000:0.0:1783951786.866304:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624359936 00000100:00100000:0.0:1783951786.866364:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783951786.866374:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:14242:x1870608624359936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.866611:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:14242:x1870608624359936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951786.866630:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81006680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:14242:1870608624359936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951786.866639:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000040:00080000:2.0:1783951786.868983:0:16351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783951786.869203:0:14242:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783951786.869228:0:14242:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951786.869241:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff8e8d75324200/0x443dabd358eed7e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7e9 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951786.869253:0:14242:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff8e8d75324200/0x443dabd358eed7e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x443dabd358eed7e9 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951787.510327:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951788.293624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951788.293753:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602349312 00000100:00100000:2.0:1783951788.293763:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602349312 00000100:00100000:2.0:1783951788.293948:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:2.0:1783951788.293961:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+6:14379:x1870608602349312:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951788.293985:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951788.294008:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed7f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038aab expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294072:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294086:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294099:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294116:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294123:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294130:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294851:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325000/0x443dabd358eed805 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294865:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325000/0x443dabd358eed805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.294873:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325000/0x443dabd358eed805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951788.294973:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783951788.294978:0:14246:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951788.295076:0:14246:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325000/0x443dabd358eed805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295093:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295099:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295106:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295112:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951788.295115:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295123:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295135:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d46530200) 00010000:00010000:2.0:1783951788.295138:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951788.295143:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295148:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed7f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951788.295173:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783951788.295255:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295271:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295277:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295282:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951788.295285:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295292:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295362:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e8d44e70100) 00010000:00010000:2.0:1783951788.295364:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951788.295368:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295374:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed7fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295411:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed7f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038aab expref: 8 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295423:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325000/0x443dabd358eed805 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038aab expref: 7 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.295430:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8d44e70300) 00010000:00010000:2.0:1783951788.295432:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951788.295440:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325000, rc 0) 00000100:00100000:2.0:1783951788.295866:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+7:14379:x1870608602349312:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1789us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951788.295874:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1783951788.305757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951788.305920:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602349568 00000100:00100000:2.0:1783951788.305929:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602349568 00000100:00100000:2.0:1783951788.305987:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1783951788.305998:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+7:14379:x1870608602349568:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951788.306026:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951788.306200:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed80c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038ab2 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.306289:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.306302:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.306313:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.306387:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.306393:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.306397:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307229:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325400/0x443dabd358eed821 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307243:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325400/0x443dabd358eed821 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307249:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325400/0x443dabd358eed821 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951788.307258:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783951788.307589:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307721:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307729:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307736:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951788.307740:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307748:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307760:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8d44e70300) 00010000:00010000:2.0:1783951788.307763:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951788.307768:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307774:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325200/0x443dabd358eed813 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307786:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307917:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307925:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307930:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:2.0:1783951788.307933:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307940:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307947:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8d44e70100) 00010000:00010000:2.0:1783951788.307951:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951788.307953:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.307959:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed81a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.308383:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed80c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ab2 expref: 10 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.308400:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325400/0x443dabd358eed821 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ab2 expref: 9 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.308408:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d44e70f00) 00010000:00010000:2.0:1783951788.308410:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951788.308418:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325400, rc 0) 00000100:00100000:2.0:1783951788.308506:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14379:x1870608602349568:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 2501us (2753us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783951788.308516:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1783951788.317698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.317786:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602349696 00000100:00100000:0.0:1783951788.317807:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602349696 00000100:00100000:0.0:1783951788.317905:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1783951788.317916:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14379:x1870608602349696:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783951788.318036:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14379:x1870608602349696:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 121us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951788.318044:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1783951788.391596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951788.391912:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602349824 00000100:00100000:1.0:1783951788.391924:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602349824 00000100:00100000:1.0:1783951788.391988:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1783951788.391998:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14385:x1870608602349824:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951788.392028:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951788.392052:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed82f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038ab9 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.392219:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.392247:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.392258:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.392273:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.392280:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.392287:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393381:0:14244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393394:0:14244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393402:0:14244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393409:0:14244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951788.393415:0:14244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393424:0:14244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393441:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d46530200) 00010000:00010000:1.0:1783951788.393452:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951788.393459:0:14244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393466:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393483:0:14244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393703:0:14244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393932:0:14244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393939:0:14244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951788.393942:0:14244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393950:0:14244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393959:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8d71d6d200) 00010000:00010000:1.0:1783951788.393962:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951788.393965:0:14244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.393971:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed83d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.394040:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed82f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ab9 expref: 10 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.394060:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d46530200) 00010000:00010000:1.0:1783951788.394063:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951788.394121:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed82f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ab9 expref: 10 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.394133:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28400, rc 0) 00000100:00100000:1.0:1783951788.394217:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14385:x1870608602349824:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 2219us (2631us total) trans 0 rc 301/301 00000100:00100000:1.0:1783951788.394226:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1783951788.403919:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.406021:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951788.406048:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624360064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951788.406133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951788.406265:0:14882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624360064 00000100:00100000:1.0:1783951788.406273:0:14882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624360064 00000100:00100000:1.0:1783951788.406333:0:14882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951788.406345:0:14882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624360064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951788.406391:0:14882:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783951788.406442:0:14882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624360064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951788.406451:0:14882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1783951788.406848:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951788.406890:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624360064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951788.407193:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624360448:0@lo:400:kworker.0 00000100:00100000:0.0:1783951788.407231:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951788.407254:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951788.407259:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624360576:0@lo:400:kworker.0 00000100:00100000:0.0:1783951788.407281:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951788.407323:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624360448 00000100:00100000:0.0:1783951788.407328:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624360448 00000100:00100000:0.0:1783951788.407359:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624360576 00000100:00100000:0.0:1783951788.407362:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624360576 00000100:00100000:0.0:1783951788.407388:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783951788.407394:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624360448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951788.407455:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870608624360448:12345-0@lo:400:kworker.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951788.407461:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783951788.407478:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951788.407485:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624360576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951788.407641:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870608624360576:12345-0@lo:400:kworker.0 Request processed in 157us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951788.407647:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1783951788.407664:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951788.407685:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1870608624360576:0@lo:400:kworker.0 00000100:00100000:0.0:1783951788.407695:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870608624360448:0@lo:400:kworker.0 00000100:00100000:3.0:1783951788.408106:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624360320:0@lo:400:kworker.0 00000100:00100000:3.0:1783951788.408143:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951788.408184:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783951788.408191:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3315:1870608624360192:0@lo:400:kworker.0 00000100:00100000:3.0:1783951788.408217:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951788.408239:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624360704:0@lo:400:kworker.0 00000100:00100000:3.0:1783951788.408260:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951788.408288:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624360192 00000100:00100000:3.0:1783951788.408316:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624360192 00000100:00100000:3.0:1783951788.408358:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783951788.408365:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3315:x1870608624360192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951788.408402:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3315:x1870608624360192:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.408407:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783951788.408445:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3315:1870608624360192:0@lo:400:kworker.0 00000100:00100000:3.0:1783951788.408462:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624360704 00000100:00100000:3.0:1783951788.408465:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624360704 00000100:00100000:3.0:1783951788.408628:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951788.408636:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624360704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951788.408673:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624360704:12345-0@lo:400:kworker.0 Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.408678:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1783951788.408693:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951788.408710:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624360704:0@lo:400:kworker.0 00000100:00100000:0.0:1783951788.409214:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624360320 00000100:00100000:0.0:1783951788.409219:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624360320 00000100:00100000:0.0:1783951788.409266:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951788.409273:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624360320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951788.409331:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624360320:12345-0@lo:400:kworker.0 Request processed in 59us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951788.409337:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951788.409369:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624360320:0@lo:400:kworker.0 00000100:00080000:1.0:1783951788.409431:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951788.409779:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602349952 00000100:00100000:2.0:1783951788.409785:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602349952 00000100:00100000:2.0:1783951788.409862:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1783951788.409870:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14385:x1870608602349952:12345-192.168.201.6@tcp:700:lfs.0 00000100:00100000:2.0:1783951788.409934:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14385:x1870608602349952:12345-192.168.201.6@tcp:700:lfs.0 Request processed in 65us (6027us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951788.409940:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783951788.412944:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951788.412971:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624360832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951788.413057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951788.413228:0:14882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624360832 00000100:00100000:3.0:1783951788.413236:0:14882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624360832 00000100:00100000:3.0:1783951788.413288:0:14882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951788.413308:0:14882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624360832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951788.413349:0:14882:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783951788.413404:0:14882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870608624360832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.413412:0:14882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951788.413617:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1870608624360832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951788.416079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.416353:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602350208 00000100:00100000:0.0:1783951788.416365:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602350208 00000100:00100000:0.0:1783951788.416503:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1783951788.416515:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14385:x1870608602350208:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:0.0:1783951788.416588:0:14245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951788.416639:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfce00/0x443dabd358eed772 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a34 expref: 9 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.416663:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d46530200) 00010000:00010000:0.0:1783951788.416669:0:14245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951788.417063:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.417080:0:14245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 5 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.417090:0:14245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.417127:0:14245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 5 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.417143:0:14245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 5 pid: 16023 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951788.417160:0:14245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14245:1870608624360960:192.168.201.6@tcp:104: 00000100:00100000:0.0:1783951788.417259:0:14245:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d45293c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951788.429192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.429316:0:14245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14245:1870608624360960:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951788.429346:0:14245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951788.429462:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602350336 00000100:00100000:3.0:1783951788.429469:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602350336 00010000:00010000:3.0:1783951788.429661:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 6 pid: 16023 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951788.429710:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1783951788.429722:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26878562-7460-4897-9435-927f340b8f45+6:2359:x1870608602350336:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951788.429739:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951788.429747:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 6 pid: 16023 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.429760:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 6 pid: 16023 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.429784:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed7aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038a96 expref: 6 pid: 16023 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.429873:0:14231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d46530200) 00010000:00010000:3.0:1783951788.429879:0:14231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.429890:0:14231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.429898:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.429922:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951788.429985:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26878562-7460-4897-9435-927f340b8f45+5:2359:x1870608602350336:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 264us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.429993:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:1.0:1783951788.430992:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783951788.432159:0:14245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.432191:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.432218:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.432230:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.432239:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951788.433608:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783951788.433626:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.433636:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.433643:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.433649:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ece00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951788.433654:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.433661:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.433675:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d46530200) 00010000:00010000:0.0:1783951788.433678:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951788.433690:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.433697:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed844 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951788.433722:0:14245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a4aa80b reply state 000000000e82ed1a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951788.433730:0:14245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951788.433896:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+10:14385:x1870608602350208:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 17378us (17822us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783951788.433906:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00010000:00010000:0.0:1783951788.445563:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.445583:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.445591:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.445598:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951788.445603:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.445609:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.445628:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951788.445631:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951788.445636:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.445657:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed84b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.541975:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951788.587566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.587723:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602350464 00000100:00100000:0.0:1783951788.587733:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602350464 00000100:00100000:0.0:1783951788.587841:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:0.0:1783951788.587853:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+9:14393:x1870608602350464:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:0.0:1783951788.587894:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951788.587931:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038ac0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.588012:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed859 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.588030:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.588042:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951788.588123:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783951788.588128:0:14246:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1783951788.588298:0:14246:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.588325:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ac0 expref: 11 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.588343:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ece00/0x443dabd358eed859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ac0 expref: 10 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.588366:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951788.588369:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951788.588373:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ece00, rc 0) 00000100:00100000:0.0:1783951788.588442:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+10:14393:x1870608602350464:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 591us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951788.588450:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:2.0:1783951788.617980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951788.618615:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602350592 00000100:00100000:3.0:1783951788.618627:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602350592 00000100:00100000:3.0:1783951788.618780:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1783951788.618802:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26878562-7460-4897-9435-927f340b8f45+5:14394:x1870608602350592:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1783951788.618861:0:16023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951788.618890:0:16023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed860 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038ac7 expref: -99 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.618964:0:16023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed867 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.618978:0:16023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.618990:0:16023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951788.619066:0:16023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783951788.619070:0:16023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1783951788.619111:0:16023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.619234:0:16023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed860 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ac7 expref: 7 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.619255:0:16023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfca00/0x443dabd358eed867 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ac7 expref: 6 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.619280:0:16023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:3.0:1783951788.619466:0:16023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951788.619470:0:16023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfca00, rc 0) 00000100:00100000:3.0:1783951788.619709:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26878562-7460-4897-9435-927f340b8f45+6:14394:x1870608602350592:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 900us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.619718:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:2.0:1783951788.630669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951788.630955:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602350720 00000100:00100000:1.0:1783951788.630981:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602350720 00000100:00100000:1.0:1783951788.631049:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1783951788.631060:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+6:14394:x1870608602350720:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951788.632710:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951788.632748:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed86e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038ace expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.632858:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.632875:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.632888:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.632906:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.632914:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.632920:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635215:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed883 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635241:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635254:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951788.635342:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783951788.635347:0:14246:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951788.635381:0:14246:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635399:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635405:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635412:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635419:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951788.635422:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635429:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635442:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:1.0:1783951788.635445:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951788.635449:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635455:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635469:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635486:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635492:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635496:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951788.635500:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635506:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635514:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8d71d6d200) 00010000:00010000:1.0:1783951788.635517:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951788.635520:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635525:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed87c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635571:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed86e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ace expref: 8 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635587:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed883 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ace expref: 7 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.635595:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951788.635597:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951788.635606:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29600, rc 0) 00000100:00100000:1.0:1783951788.635696:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26878562-7460-4897-9435-927f340b8f45+7:14394:x1870608602350720:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 4636us (5036us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951788.635705:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1783951788.640054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.640139:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602350976 00000100:00100000:0.0:1783951788.640149:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602350976 00000100:00100000:0.0:1783951788.640200:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1783951788.640209:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26878562-7460-4897-9435-927f340b8f45+7:14394:x1870608602350976:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951788.640237:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951788.640258:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed88a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038ad5 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951788.640383:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783951788.640517:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed88a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ad5 expref: 9 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.640530:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951788.640533:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951788.640538:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed88a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ad5 expref: 9 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.640553:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ed200, rc 0) 00000100:00100000:0.0:1783951788.640611:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26878562-7460-4897-9435-927f340b8f45+8:14394:x1870608602350976:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 403us (565us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1783951788.640633:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:2.0:1783951788.653872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951788.653969:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602351232 00000100:00100000:1.0:1783951788.653978:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602351232 00000100:00100000:1.0:1783951788.654021:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1783951788.654028:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26878562-7460-4897-9435-927f340b8f45+8:14394:x1870608602351232:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:1.0:1783951788.654079:0:14244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951788.654101:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed883 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ace expref: 8 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.654116:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951788.654123:0:14244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951788.654141:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.654151:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.654157:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951788.654403:0:14244:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004a69802 reply state 00000000121c3ba5 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951788.654411:0:14244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783951788.654423:0:14244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1783951788.654508:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26878562-7460-4897-9435-927f340b8f45+9:14394:x1870608602351232:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 479us (646us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783951788.654526:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:2.0:1783951788.663723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951788.663860:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602351488 00000100:00100000:1.0:1783951788.663872:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602351488 00000100:00100000:1.0:1783951788.663931:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1783951788.663944:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26878562-7460-4897-9435-927f340b8f45+9:14394:x1870608602351488:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951788.664272:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26878562-7460-4897-9435-927f340b8f45+10:14394:x1870608602351488:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 330us (562us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783951788.664281:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00010000:00010000:3.0:1783951788.666069:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.666099:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.666106:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.666113:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951788.666117:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.666125:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.666142:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8d71d6d200) 00010000:00010000:3.0:1783951788.666146:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783951788.666150:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951788.666156:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed898 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951788.675629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.675722:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602351744 00000100:00100000:0.0:1783951788.675732:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602351744 00000100:00100000:0.0:1783951788.675801:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:0.0:1783951788.675852:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26878562-7460-4897-9435-927f340b8f45+9:14394:x1870608602351744:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951788.675877:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951788.675897:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed89f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038adc expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.675968:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.675979:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.675987:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.675997:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676002:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676006:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951788.676128:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783951788.676208:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676228:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676233:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676237:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ec200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951788.676240:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676244:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676254:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951788.676256:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951788.676258:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676263:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676276:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676281:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676286:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676291:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951788.676310:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676318:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676326:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8d452ae500) 00010000:00010000:0.0:1783951788.676329:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951788.676331:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676335:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676366:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed89f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038adc expref: 11 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676373:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951788.676374:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951788.676377:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed89f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038adc expref: 11 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.676382:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ed200, rc 0) 00000100:00100000:0.0:1783951788.676441:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26878562-7460-4897-9435-927f340b8f45+10:14394:x1870608602351744:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 631us (819us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1783951788.676448:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:2.0:1783951788.691544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951788.691629:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602351872 00000100:00100000:1.0:1783951788.691638:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602351872 00000100:00100000:1.0:1783951788.691714:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1783951788.691726:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26878562-7460-4897-9435-927f340b8f45+10:14394:x1870608602351872:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1783951788.691752:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951788.691776:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed8bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038ae3 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.691941:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.691957:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.691969:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951788.692042:0:14244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783951788.692046:0:14244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951788.692069:0:14244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.692123:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed8bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.692139:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.692149:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951788.692152:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951788.692155:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29000, rc 0) 00000100:00100000:1.0:1783951788.692213:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26878562-7460-4897-9435-927f340b8f45+11:14394:x1870608602351872:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 488us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951788.692232:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:2.0:1783951788.699474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951788.699612:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602352000 00000100:00100000:1.0:1783951788.699621:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602352000 00000100:00100000:1.0:1783951788.699670:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1783951788.699678:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26878562-7460-4897-9435-927f340b8f45+11:14394:x1870608602352000:12345-192.168.201.6@tcp:37:lfs.0 00000100:00100000:1.0:1783951788.705656:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26878562-7460-4897-9435-927f340b8f45+11:14394:x1870608602352000:12345-192.168.201.6@tcp:37:lfs.0 Request processed in 5964us (6179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951788.705674:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:2.0:1783951788.724778:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.725120:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602352256 00000100:00100000:0.0:1783951788.725132:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602352256 00000100:00100000:0.0:1783951788.725186:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1783951788.725197:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d605c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26878562-7460-4897-9435-927f340b8f45+11:14394:x1870608602352256:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1783951788.725795:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d605c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26878562-7460-4897-9435-927f340b8f45+12:14394:x1870608602352256:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 590us (1020us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783951788.725804:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1783951788.812101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.812266:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602352384 00000100:00100000:0.0:1783951788.812276:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602352384 00000100:00100000:0.0:1783951788.812347:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:0.0:1783951788.812358:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+10:14400:x1870608602352384:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1783951788.812382:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951788.812404:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed8c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038aea expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812470:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812496:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812506:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812519:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812526:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812531:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812642:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5edc00/0x443dabd358eed8de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812664:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5edc00/0x443dabd358eed8de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.812671:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5edc00/0x443dabd358eed8de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951788.812989:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783951788.812994:0:14245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783951788.813040:0:14245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5edc00/0x443dabd358eed8de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813053:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813060:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813066:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813072:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951788.813142:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813150:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813162:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951788.813165:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951788.813170:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813189:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed8d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813204:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813210:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813216:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813221:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ec200 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951788.813224:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813231:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813239:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8d452ae500) 00010000:00010000:0.0:1783951788.813241:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951788.813244:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813249:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed8d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813283:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed200/0x443dabd358eed8c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038aea expref: 12 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813371:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5edc00/0x443dabd358eed8de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038aea expref: 11 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.813379:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951788.813381:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783951788.813384:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5edc00, rc 0) 00000100:00100000:0.0:1783951788.813451:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+11:14400:x1870608602352384:12345-192.168.201.6@tcp:101:bash.0 Request processed in 1093us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951788.813459:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1783951788.821634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951788.822004:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602352640 00000100:00100000:1.0:1783951788.822015:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602352640 00000100:00100000:1.0:1783951788.822083:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1783951788.822094:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+11:14400:x1870608602352640:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1783951788.822119:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951788.822140:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed8e5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038af1 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.822309:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.822325:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.822334:0:14244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.822369:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 11 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.822382:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 11 pid: 14244 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951788.822396:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a089180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14244:1870608624361088:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951788.822495:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aa600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951788.826274:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a089180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14244:1870608624361088:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951788.826322:0:14244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951788.827645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.827839:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602352768 00000100:00100000:0.0:1783951788.827848:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602352768 00010000:00010000:0.0:1783951788.827887:0:14229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 12 pid: 14244 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951788.827928:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1783951788.827937:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81007800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26878562-7460-4897-9435-927f340b8f45+12:2358:x1870608602352768:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951788.827952:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951788.827960:0:14229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 12 pid: 14244 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.827973:0:14229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 12 pid: 14244 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.827995:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29000/0x443dabd358eed8c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038ae3 expref: 12 pid: 14244 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.828034:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951788.828040:0:14229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.828050:0:14229:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.828058:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.828090:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951788.828147:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81007800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26878562-7460-4897-9435-927f340b8f45+11:2358:x1870608602352768:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 210us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951788.828155:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00010000:00010000:1.0:1783951788.828445:0:14244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.828454:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.828477:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.828495:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.828504:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830483:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830503:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830515:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951788.830526:0:14244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783951788.830560:0:14244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830567:0:14244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830574:0:14244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830579:0:14244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951788.830584:0:14244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830591:0:14244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830619:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:1.0:1783951788.830622:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951788.830627:0:14244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.830632:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed8ec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951788.830646:0:14244:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088d84628 reply state 0000000011a17580 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951788.830655:0:14244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783951788.833899:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed8e5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 14 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.833940:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 13 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951788.833951:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:1.0:1783951788.833955:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783951788.833958:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28400, rc 0) 00000100:00100000:1.0:1783951788.834043:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+14:14400:x1870608602352640:12345-192.168.201.6@tcp:101:bash.0 Request processed in 11950us (12420us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783951788.834053:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00010000:00010000:0.0:1783951788.838776:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.838805:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.838850:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.838857:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951788.838863:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.838870:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.838912:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e8d71d6df00) 00010000:00010000:0.0:1783951788.838916:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951788.838921:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.838928:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed8f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951788.854692:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783951788.855213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951788.855338:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602352896 00000100:00100000:2.0:1783951788.855348:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602352896 00000100:00100000:2.0:1783951788.855395:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1783951788.855403:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+13:14400:x1870608602352896:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1783951788.855425:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951788.855444:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324a00/0x443dabd358eed908 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038af8 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.855504:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.855518:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.855530:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951788.855574:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783951788.855578:0:14245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783951788.855594:0:14245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.855602:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.855621:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324a00/0x443dabd358eed908 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 15 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.855633:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 14 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951788.855649:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:2.0:1783951788.855652:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951788.855654:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75324600, rc 0) 00000100:00100000:2.0:1783951788.855713:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+14:14400:x1870608602352896:12345-192.168.201.6@tcp:101:bash.0 Request processed in 311us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951788.855718:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:0.0:1783951788.861350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951788.861418:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602353152 00000100:00100000:2.0:1783951788.861427:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602353152 00000100:00100000:2.0:1783951788.861481:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1783951788.861492:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+14:14400:x1870608602353152:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:2.0:1783951788.861903:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+15:14400:x1870608602353152:12345-192.168.201.6@tcp:35:bash.0 Request processed in 411us (561us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783951788.861913:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1783951788.882999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951788.883101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951788.883135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951788.883173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951788.883200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951788.883852:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602353536 00000100:00100000:3.0:1783951788.883864:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602353536 00000100:00100000:3.0:1783951788.883918:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602353792 00000100:00100000:3.0:1783951788.883936:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602353792 00000100:00100000:3.0:1783951788.883955:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602353408 00000100:00100000:3.0:1783951788.883958:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602353408 00000100:00100000:3.0:1783951788.883971:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602353664 00000100:00100000:3.0:1783951788.883974:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602353664 00000100:00100000:3.0:1783951788.883992:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:3.0:1783951788.884016:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2360:x1870608602353536:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951788.884113:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2360:x1870608602353536:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 112us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.884122:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:3.0:1783951788.884140:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1783951788.884146:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26878562-7460-4897-9435-927f340b8f45+5:2360:x1870608602353792:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951788.884173:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26878562-7460-4897-9435-927f340b8f45+5:2360:x1870608602353792:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.884179:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1783951788.884188:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1783951788.884193:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2360:x1870608602353408:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951788.884212:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2360:x1870608602353408:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 18us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.884231:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1783951788.884244:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1783951788.884250:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26878562-7460-4897-9435-927f340b8f45+5:2360:x1870608602353664:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951788.884273:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26878562-7460-4897-9435-927f340b8f45+5:2360:x1870608602353664:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951788.884279:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00080000:2.0:1783951788.885179:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951788.885185:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951788.887315:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602353280 00000100:00100000:0.0:1783951788.887330:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602353280 00000100:00100000:0.0:1783951788.887475:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:0.0:1783951788.887487:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:2360:x1870608602353280:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951788.887577:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:2360:x1870608602353280:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (4585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951788.887584:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:2.0:1783951788.990611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951788.990900:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602354048 00000100:00100000:0.0:1783951788.990911:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602354048 00000100:00100000:0.0:1783951788.990987:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:0.0:1783951788.990998:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+15:14410:x1870608602354048:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1783951788.991026:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951788.991050:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038aff expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951788.991178:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783951788.991602:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed916 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038aff expref: 17 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.991631:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8d452ae900) 00010000:00010000:0.0:1783951788.991634:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951788.991640:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038aff expref: 17 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951788.991655:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ed800, rc 0) 00000100:00100000:0.0:1783951788.991956:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+16:14410:x1870608602354048:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 958us (1354us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1783951788.991963:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1783951789.002184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.002257:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602354304 00000100:00100000:0.0:1783951789.002268:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602354304 00000100:00100000:0.0:1783951789.002641:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1783951789.002653:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+16:14410:x1870608602354304:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1783951789.003101:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+17:14410:x1870608602354304:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 449us (927us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1783951789.003110:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1783951789.061952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951789.062102:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602354560 00000100:00100000:2.0:1783951789.062113:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602354560 00000100:00100000:2.0:1783951789.062180:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:2.0:1783951789.062192:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+17:14413:x1870608602354560:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1783951789.062237:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951789.062258:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed924 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b06 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951789.062382:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed92b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951789.062397:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed92b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951789.062408:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed92b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951789.062421:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783951789.062572:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324400/0x443dabd358eed924 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b06 expref: 20 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951789.062593:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed92b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b06 expref: 19 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951789.062602:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:2.0:1783951789.062605:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951789.062609:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325600, rc 0) 00000100:00100000:2.0:1783951789.062673:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+19:14413:x1870608602354560:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 483us (730us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783951789.062680:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:2.0:1783951789.073110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951789.073192:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602354688 00000100:00100000:1.0:1783951789.073202:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602354688 00000100:00100000:1.0:1783951789.073259:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:1.0:1783951789.073270:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+19:14413:x1870608602354688:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1783951789.073360:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073378:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073389:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073421:0:14244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073429:0:14244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073436:0:14244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073442:0:14244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:1.0:1783951789.073446:0:14244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073454:0:14244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073465:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:1.0:1783951789.073468:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951789.073473:0:14244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.073491:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed939 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951789.073617:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+19:14413:x1870608602354688:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 348us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951789.073625:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:1.0:1783951789.092388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951789.092495:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602354816 00000100:00100000:2.0:1783951789.092507:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602354816 00000100:00100000:2.0:1783951789.092591:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1783951789.092603:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+19:2359:x1870608602354816:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951789.092621:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951789.092646:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eed92b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b06 expref: 19 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951789.092665:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:2.0:1783951789.092670:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951789.092736:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+18:2359:x1870608602354816:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 134us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951789.092743:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1783951789.095481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951789.095584:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602355072 00000100:00100000:1.0:1783951789.095596:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602355072 00000100:00100000:1.0:1783951789.095731:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1783951789.095750:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+18:14413:x1870608602355072:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1783951789.096053:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+19:14413:x1870608602355072:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 304us (581us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1783951789.096060:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:2.0:1783951789.523432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.523993:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602355328 00000100:00100000:0.0:1783951789.524009:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602355328 00000100:00100000:0.0:1783951789.524100:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1783951789.524112:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+19:14444:x1870608602355328:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1783951789.524144:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951789.524180:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed940 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b0d expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.524322:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed947 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.524334:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed947 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.524344:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed947 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951789.524352:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783951789.524484:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed940 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b0d expref: 22 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.524502:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed947 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b0d expref: 21 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.524511:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951789.524514:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951789.524518:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ed600, rc 0) 00000100:00100000:0.0:1783951789.524576:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+21:14444:x1870608602355328:12345-192.168.201.6@tcp:101:cat.0 Request processed in 466us (1153us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1783951789.524584:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:2.0:1783951789.537028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951789.537132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.537218:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602355584 00000100:00100000:0.0:1783951789.537229:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602355584 00000100:00100000:0.0:1783951789.537303:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1783951789.537314:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+21:14444:x1870608602355584:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:0.0:1783951789.537692:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+22:14444:x1870608602355584:12345-192.168.201.6@tcp:35:cat.0 Request processed in 375us (671us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1783951789.537715:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1783951789.538007:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602355712 00000100:00100000:3.0:1783951789.538013:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602355712 00000100:00100000:3.0:1783951789.538056:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1783951789.538064:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d757a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+22:2359:x1870608602355712:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951789.538076:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951789.541062:0:14231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed947 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b0d expref: 22 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.541089:0:14231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:3.0:1783951789.541094:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951789.545610:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d757a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+21:2359:x1870608602355712:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 7529us (8460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951789.545627:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00010000:00010000:3.0:1783951789.558093:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951789.629148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951789.629315:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602355968 00000100:00100000:1.0:1783951789.629325:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602355968 00000100:00100000:1.0:1783951789.629394:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1783951789.629406:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+21:14450:x1870608602355968:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:1.0:1783951789.629434:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951789.629457:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed955 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b14 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.629581:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.629596:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 22 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.629605:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 22 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.629627:0:14244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.629664:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 22 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.629678:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 22 pid: 14245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951789.629692:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14244:1870608624361216:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951789.629838:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 22 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951789.629849:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 22 pid: 14244 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951789.629859:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a08bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14244:1870608624361344:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951789.629891:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d512aa600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951789.639248:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14244:1870608624361216:192.168.201.6@tcp:104: 00000100:00100000:1.0:1783951789.639266:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a08bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14244:1870608624361344:192.168.201.6@tcp:104: 00010000:00010000:1.0:1783951789.639303:0:14244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951789.642153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951789.642324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.643022:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602356224 00000100:00100000:0.0:1783951789.643034:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602356224 00010000:00010000:0.0:1783951789.643085:0:14229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 23 pid: 14244 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951789.643124:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602356096 00000100:00100000:0.0:1783951789.643127:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602356096 00010000:00010000:0.0:1783951789.643142:0:14229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 24 pid: 14245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951789.643157:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1783951789.643165:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d750b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+24:2358:x1870608602356224:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951789.643180:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951789.643186:0:14229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 24 pid: 14244 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.643197:0:14229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 24 pid: 14244 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.643458:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed8fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af1 expref: 24 pid: 14244 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.643483:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951789.643489:0:14229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.643516:0:14229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.643522:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951789.643589:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d750b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+23:2358:x1870608602356224:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 423us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.643597:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1783951789.643650:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1783951789.643657:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+22:2358:x1870608602356096:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951789.643666:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951789.643671:0:14229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 22 pid: 14245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.643681:0:14229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 22 pid: 14245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.643693:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75324600/0x443dabd358eed90f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038af8 expref: 22 pid: 14245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.643704:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951789.644402:0:14229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.644417:0:14229:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.644425:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.644462:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951789.644507:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+21:2358:x1870608602356096:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 848us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.644515:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00010000:00010000:0.0:1783951789.644548:0:14244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.644555:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951789.644574:0:14244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783951789.645141:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eed955 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b14 expref: 22 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.645159:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29600/0x443dabd358eed95c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b14 expref: 21 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.645167:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951789.645169:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783951789.645172:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e29600, rc 0) 00000100:00100000:0.0:1783951789.645200:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+21:14450:x1870608602355968:12345-192.168.201.6@tcp:101:dd.0 Request processed in 15798us (16064us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1783951789.645386:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1783951789.650219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.650302:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602356480 00000100:00100000:0.0:1783951789.650311:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602356480 00000100:00100000:0.0:1783951789.650370:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:0.0:1783951789.650380:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+21:14450:x1870608602356480:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:0.0:1783951789.650697:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.650733:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.650746:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951789.650855:0:14245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1783951789.650894:0:14245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8564468 reply state 00000000b7e77c2e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951789.650903:0:14245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951789.651012:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14450:x1870608602356480:12345-192.168.201.6@tcp:36:dd.0 Request processed in 632us (812us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1783951789.651021:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000020:00080000:0.0:1783951789.651026:0:14245:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783951789.654450:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.654482:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.654492:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.654499:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951789.654504:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.654514:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.654557:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:3.0:1783951789.654561:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951789.654568:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.654575:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed96a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951789.657154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.657333:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602356608 00000100:00100000:0.0:1783951789.657344:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602356608 00000100:00100000:0.0:1783951789.657412:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:0.0:1783951789.657422:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+23:14450:x1870608602356608:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:0.0:1783951789.657451:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951789.657486:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed971 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b1b expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.657561:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed971 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b1b expref: 24 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.657577:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed971 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b1b expref: 24 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.657609:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951789.657612:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951789.657616:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ec800, rc 0) 00000100:00100000:0.0:1783951789.657690:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14450:x1870608602356608:12345-192.168.201.6@tcp:101:dd.0 Request processed in 267us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.657698:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:2.0:1783951789.677254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.677363:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602356864 00000100:00100000:0.0:1783951789.677373:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602356864 00000100:00100000:0.0:1783951789.677441:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:0.0:1783951789.677451:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14450:x1870608602356864:12345-192.168.201.6@tcp:103:dd.0 00010000:00010000:0.0:1783951789.677475:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951789.677505:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed971 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b1b expref: 24 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.677527:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951789.677531:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951789.677593:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+23:14450:x1870608602356864:12345-192.168.201.6@tcp:103:dd.0 Request processed in 142us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.677602:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1783951789.681663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.681786:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602356992 00000100:00100000:0.0:1783951789.681797:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602356992 00000100:00100000:0.0:1783951789.681914:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:0.0:1783951789.681926:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+23:14450:x1870608602356992:12345-192.168.201.6@tcp:58:dd.0 00010000:00010000:0.0:1783951789.682065:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.682092:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.682106:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951789.683011:0:14245:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951789.683195:0:14245:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1783951789.683282:0:14245:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1783951789.683420:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+23:14450:x1870608602356992:12345-192.168.201.6@tcp:58:dd.0 Request processed in 1491us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.683434:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:1.0:1783951789.691059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.691161:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602357120 00000100:00100000:0.0:1783951789.691172:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602357120 00000100:00100000:0.0:1783951789.691246:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:0.0:1783951789.691258:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+23:14450:x1870608602357120:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:0.0:1783951789.691291:0:14246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951789.691317:0:14246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed97f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b22 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.691393:0:14246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.691406:0:14246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed97f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b22 expref: 24 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.691427:0:14246:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.691462:0:14246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed97f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b22 expref: 24 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.691476:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951789.691480:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951789.691485:0:14246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed97f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b22 expref: 24 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.691493:0:14246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ec800, rc 0) 00000100:00100000:0.0:1783951789.691573:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14450:x1870608602357120:12345-192.168.201.6@tcp:101:dd.0 Request processed in 316us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.691581:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000040:00080000:2.0:1783951789.878385:0:14279:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783951789.878400:0:14279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951789.878477:0:14279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783951789.878484:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783951789.878635:0:14279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f618a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14279:1870608624361472:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951789.878777:0:14279:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d45293240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951789.884145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951789.884333:0:14279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f618a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14279:1870608624361472:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783951789.884341:0:14255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602357248 00000100:00100000:3.0:1783951789.884349:0:14255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602357248 00000100:00100000:3.0:1783951789.884409:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1783951789.884419:0:14255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14451:x1870608602357248:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783951789.884515:0:14255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14451:x1870608602357248:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 Request processed in 96us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951789.884524:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783951789.888046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.889179:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602357376 00000100:00100000:0.0:1783951789.889194:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602357376 00000100:00100000:0.0:1783951789.889293:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1783951789.889306:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14451:x1870608602357376:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783951789.889379:0:14245:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783951789.889535:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14451:x1870608602357376:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 231us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.889544:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:1.0:1783951789.897126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.898183:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602357504 00000100:00100000:0.0:1783951789.898249:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602357504 00000100:00100000:0.0:1783951789.898326:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:0.0:1783951789.898338:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14451:x1870608602357504:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783951789.898422:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.898462:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.898475:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.898541:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.898550:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.898557:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.898587:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.898595:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.898603:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951789.899325:0:14246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783951789.899331:0:14246:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783951789.899351:0:14246:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899364:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899383:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899390:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899397:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ec600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951789.899402:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899410:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899425:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d44e70f00) 00010000:00010000:0.0:1783951789.899428:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951789.899433:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899439:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed986 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899454:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899460:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899465:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899471:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed400 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951789.899481:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899486:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899494:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e8d452ae500) 00010000:00010000:0.0:1783951789.899497:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951789.899500:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899505:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed98d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899522:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899528:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899534:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899538:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951789.899541:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899547:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899554:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951789.899556:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951789.899566:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.899572:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed994 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951789.900007:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14451:x1870608602357504:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 1666us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.900018:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:1.0:1783951789.905482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951789.906331:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602357760 00000100:00100000:3.0:1783951789.906345:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602357760 00000100:00100000:3.0:1783951789.906470:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:3.0:1783951789.906484:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+24:14451:x1870608602357760:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951789.906513:0:16023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951789.906539:0:16023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed99b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b29 expref: -99 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.906673:0:16023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.906689:0:16023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907469:0:16023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951789.907486:0:16023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783951789.907613:0:16023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907622:0:16023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907629:0:16023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907635:0:16023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d76dfda00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951789.907639:0:16023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907646:0:16023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907659:0:16023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:3.0:1783951789.907662:0:16023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783951789.907667:0:16023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907673:0:16023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfda00/0x443dabd358eed9a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907741:0:16023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed99b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b29 expref: 26 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907952:0:16023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8d44e70f00) 00010000:00010000:3.0:1783951789.907956:0:16023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951789.907962:0:16023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d76dfde00/0x443dabd358eed99b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b29 expref: 26 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951789.907973:0:16023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d76dfde00, rc 0) 00000100:00100000:3.0:1783951789.908112:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+25:14451:x1870608602357760:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1631us (2638us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1783951789.908121:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:2.0:1783951789.913223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.913374:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602357888 00000100:00100000:0.0:1783951789.913386:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602357888 00000100:00100000:0.0:1783951789.913471:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1783951789.913482:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+25:14451:x1870608602357888:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783951789.913527:0:14246:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783951789.913671:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+25:14451:x1870608602357888:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 190us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.913681:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:1.0:1783951789.923287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.923668:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602358144 00000100:00100000:0.0:1783951789.923679:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602358144 00000100:00100000:0.0:1783951789.923765:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:0.0:1783951789.923785:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+25:14451:x1870608602358144:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951789.923842:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951789.923866:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b30 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951789.924573:0:14245:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1783951789.924581:0:14245:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1783951789.924643:0:14245:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1783951789.925063:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed9b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.925080:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.925094:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.925164:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b30 expref: 28 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.925182:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b30 expref: 27 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.925192:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:0.0:1783951789.925195:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951789.925198:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ed400, rc 0) 00000100:00100000:0.0:1783951789.925282:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+27:14451:x1870608602358144:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1498us (2005us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1783951789.925291:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1783951789.929875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.930023:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602358400 00000100:00100000:0.0:1783951789.930032:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602358400 00000100:00100000:0.0:1783951789.930081:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:0.0:1783951789.930091:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+27:14451:x1870608602358400:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951789.930150:0:14246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951789.930176:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed400/0x443dabd358eed9b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b30 expref: 27 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930214:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae500) 00010000:00010000:0.0:1783951789.930225:0:14246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951789.930247:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930261:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930282:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930344:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930353:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930359:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930441:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930448:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930455:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930460:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ec600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951789.930475:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930491:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930500:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8d71d6d100) 00010000:00010000:0.0:1783951789.930503:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951789.930506:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930512:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec600/0x443dabd358eed9c5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930521:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930527:0:14246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930534:0:14246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930539:0:14246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951789.930541:0:14246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930548:0:14246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930554:0:14246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa49e78a5 (ffff8e8d452ae600) 00010000:00010000:0.0:1783951789.930557:0:14246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951789.930559:0:14246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.930577:0:14246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa49e78a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951789.930671:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+26:14451:x1870608602358400:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 580us (805us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951789.930680:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1783951789.933622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.933709:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602358528 00000100:00100000:0.0:1783951789.933719:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602358528 00000100:00100000:0.0:1783951789.933801:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:0.0:1783951789.933856:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+26:14451:x1870608602358528:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951789.933878:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951789.933901:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b37 expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.933944:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed9da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.933960:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed9da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.933971:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed9da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.934088:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b37 expref: 28 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.934106:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec200/0x443dabd358eed9da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b37 expref: 27 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.934125:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:0.0:1783951789.934129:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951789.934132:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ec200, rc 0) 00000100:00100000:0.0:1783951789.934200:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+27:14451:x1870608602358528:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 390us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.934207:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:2.0:1783951789.937924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.938080:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602358784 00000100:00100000:0.0:1783951789.938091:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602358784 00000100:00100000:0.0:1783951789.938155:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1783951789.938166:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+27:14451:x1870608602358784:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951789.938256:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.938281:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.938293:0:14246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951789.938742:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1783951789.938753:0:14246:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 506843942718ns, next at 507843940003ns, rc = 0 00000004:00010000:0.0:1783951789.938882:0:14246:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000466bad39 reply state 00000000fb2b7aaa transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951789.938892:0:14246:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951789.938997:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+29:14451:x1870608602358784:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 830us (1088us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1783951789.939022:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00010000:00010000:0.0:1783951789.947904:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.947922:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.947931:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.947937:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951789.947941:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.947948:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.947964:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:0.0:1783951789.947968:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951789.947973:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.947980:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed600/0x443dabd358eed9e1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14246 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951789.954845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.954960:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602358912 00000100:00100000:0.0:1783951789.954971:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602358912 00000100:00100000:0.0:1783951789.955036:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:0.0:1783951789.955047:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+28:14451:x1870608602358912:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951789.955074:0:14245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951789.955111:0:14245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b3e expref: -99 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.955179:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 29 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.955195:0:14245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 29 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951789.955218:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:0.0:1783951789.955222:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951789.955225:0:14245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ed800, rc 0) 00000100:00100000:0.0:1783951789.955294:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+29:14451:x1870608602358912:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 248us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.955302:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:2.0:1783951789.972336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951789.972535:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602359040 00000100:00100000:3.0:1783951789.972558:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602359040 00000100:00100000:3.0:1783951789.972625:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1783951789.972641:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2359:x1870608602359040:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783951789.973095:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2359:x1870608602359040:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 459us (769us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783951789.973105:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:2.0:1783951789.986398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.986506:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602359296 00000100:00100000:0.0:1783951789.986516:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602359296 00000100:00100000:0.0:1783951789.986579:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:0.0:1783951789.986589:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+29:14451:x1870608602359296:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783951789.987072:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+30:14451:x1870608602359296:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 481us (682us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1783951789.987080:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1783951789.992534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951789.996388:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602359552 00000100:00100000:0.0:1783951789.996406:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602359552 00000100:00100000:0.0:1783951789.996571:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:0.0:1783951789.996584:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+30:14451:x1870608602359552:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783951789.996721:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+30:14451:x1870608602359552:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 140us (4262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951789.996742:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:2.0:1783951790.002122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.008050:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602359680 00000100:00100000:1.0:1783951790.008069:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602359680 00000100:00100000:1.0:1783951790.008183:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1783951790.008198:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+30:14451:x1870608602359680:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951790.008219:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951790.008243:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed9ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b45 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.008340:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed9f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.008356:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.008368:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951790.008418:0:14244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783951790.008441:0:14244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783951790.008682:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783951790.008743:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eed9ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b45 expref: 32 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.008804:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b45 expref: 31 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.008858:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:1.0:1783951790.008862:0:14244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783951790.008866:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d42e28400, rc 0) 00000100:00100000:1.0:1783951790.008935:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+31:14451:x1870608602359680:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 742us (6822us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951790.008942:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1783951790.017103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951790.017229:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602359808 00000100:00100000:0.0:1783951790.017239:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602359808 00000100:00100000:0.0:1783951790.017307:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1783951790.017319:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+6:2358:x1870608602359808:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951790.017339:0:14877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951790.017363:0:14877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b4c expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951790.017394:0:14877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54f1ae, blocks: 0x1 00010000:00010000:0.0:1783951790.017416:0:14877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1783951790.017421:0:14877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951790.017432:0:14877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 7 pid: 14877 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.017452:0:14877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 7 pid: 14877 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.017478:0:14877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d6d5ed600, rc 0) 00000100:00100000:0.0:1783951790.017553:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+7:2358:x1870608602359808:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 236us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951790.017560:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00080000:2.0:1783951790.018285:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951790.020436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.020653:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602360064 00000100:00100000:1.0:1783951790.020665:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602360064 00000100:00100000:1.0:1783951790.020731:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:1.0:1783951790.020742:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+31:14451:x1870608602360064:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783951790.020899:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+31:14451:x1870608602360064:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 158us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951790.020908:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:3.0:1783951790.028301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951790.028448:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602360192 00000100:00100000:0.0:1783951790.028460:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602360192 00000100:00100000:0.0:1783951790.028533:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:0.0:1783951790.028550:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+31:14451:x1870608602360192:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783951790.167665:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1783951790.167684:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1783951790.167729:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1783951790.169669:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951790.169697:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d81339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624361600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783951790.169784:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951790.169918:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624361600 00000100:00100000:3.0:1783951790.169927:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624361600 00000100:00100000:3.0:1783951790.169995:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951790.170004:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870608624361600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783951790.170188:0:14880:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783951790.170192:0:14880:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1783951790.170195:0:14880:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783951790.170197:0:14880:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783951790 -> 1783951790 00002000:00010000:3.0:1783951790.170216:0:14880:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783951790.170260:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1870608624361600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 256us (475us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1783951790.170338:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1783951790.170395:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8d81339c00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1783951790.170402:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d81339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1870608624361600:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1783951790.170639:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951790.173977:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+14:14451:x1870608602360192:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 145413us (145671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951790.173991:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1783951790.179009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951790.187120:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602360320 00000100:00100000:0.0:1783951790.187137:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602360320 00000100:00100000:1.0:1783951790.187376:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1783951790.187389:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+7:2359:x1870608602360320:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783951790.189305:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+7:2359:x1870608602360320:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 1905us (10292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951790.189320:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1783951790.194011:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.194151:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602360576 00000100:00100000:1.0:1783951790.194163:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602360576 00000100:00100000:1.0:1783951790.194225:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:1.0:1783951790.194237:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8133b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+14:14451:x1870608602360576:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783951790.194364:0:14244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951790.194395:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28400/0x443dabd358eed9f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b45 expref: 14 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.194417:0:14244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:1.0:1783951790.194422:0:14244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951790.194453:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.194866:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.194879:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951790.195107:0:14244:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6b2883a reply state 000000009646c2df transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951790.195117:0:14244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951790.195217:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8133b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+15:14451:x1870608602360576:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 980us (1216us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1783951790.195225:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:3.0:1783951790.199619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:3.0:1783951790.199723:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.199737:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.199744:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.199750:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e29c00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:3.0:1783951790.199756:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.199772:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.199790:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:3.0:1783951790.199794:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951790.199799:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.199805:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e29c00/0x443dabd358eeda04 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951790.204134:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602360704 00000100:00100000:2.0:1783951790.204152:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602360704 00000100:00100000:2.0:1783951790.204281:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1783951790.204293:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+7:14451:x1870608602360704:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951790.204314:0:14880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951790.204337:0:14880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x736c4e45a038b53 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.204373:0:14880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 8 pid: 14877 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.204404:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783951790.204408:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951790.204415:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.204453:0:14880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 8 pid: 14877 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.204478:0:14880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 8 pid: 14877 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951790.204493:0:14880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7f61aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14880:1870608624361728:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951790.204743:0:14880:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44d87840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951790.212239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.214048:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602360832 00000100:00100000:1.0:1783951790.214063:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602360832 00010000:00010000:1.0:1783951790.214115:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 9 pid: 14877 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951790.214197:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1783951790.214209:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f618380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+9:2359:x1870608602360832:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951790.214226:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951790.214253:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 9 pid: 14877 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.214280:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 9 pid: 14877 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.214311:0:14230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951790.214316:0:14230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951790.214323:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 9 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.214334:0:14230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 9 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.214378:0:14230:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 9 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951790.214392:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7a088e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14230:1870608624361856:192.168.201.6@tcp:105: 00000100:00100000:1.0:1783951790.214487:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d71dd6780 going to sleep for 11 seconds 00010000:00010000:3.0:1783951790.218054:0:14880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eed9fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b4c expref: 9 pid: 14877 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951790.218082:0:14880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7f61aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14880:1870608624361728:192.168.201.6@tcp:104: 00010000:00010000:3.0:1783951790.218119:0:14880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.218135:0:14880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8d75325200, rc 0) 00000100:00100000:3.0:1783951790.218319:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d81338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+8:14451:x1870608602360704:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 14028us (18710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951790.218329:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1783951790.226434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951790.227978:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7a088e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14230:1870608624361856:192.168.201.6@tcp:105: 00010000:00010000:3.0:1783951790.228029:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951790.228121:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f618380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+7:2359:x1870608602360832:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 13913us (15891us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951790.228134:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1783951790.233625:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602360960 00000100:00100000:0.0:1783951790.233639:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602360960 00000100:00100000:0.0:1783951790.237190:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1783951790.237225:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+7:2358:x1870608602360960:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783951790.237553:0:14879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783951790.237558:0:14879:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783951790 00002000:00010000:0.0:1783951790.237560:0:14879:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783951789 00002000:00010000:0.0:1783951790.237562:0:14879:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783951790 -> 1783951790 00002000:00010000:0.0:1783951790.237564:0:14879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783951790.237661:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+8:2358:x1870608602360960:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 453us (11238us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783951790.237672:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783951790.241616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951790.244089:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602361088 00000100:00100000:2.0:1783951790.244105:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602361088 00000100:00100000:2.0:1783951790.244172:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1783951790.244183:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+8:2359:x1870608602361088:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783951790.244230:0:14877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.244251:0:14877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.244293:0:14877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951790.244298:0:14877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951790.244304:0:14877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.244350:0:14877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 8 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.244365:0:14877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 8 pid: 14880 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951790.244383:0:14877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14877:1870608624361984:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951790.246292:0:14877:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44d87240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951790.257534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951790.257648:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602361216 00000100:00100000:3.0:1783951790.257661:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602361216 00010000:00010000:3.0:1783951790.257826:0:14231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 9 pid: 14880 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951790.257879:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1783951790.257891:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+9:2359:x1870608602361216:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951790.257920:0:14231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951790.257950:0:14231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 9 pid: 14880 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.257966:0:14231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 9 pid: 14880 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.258341:0:14231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951790.258348:0:14231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951790.258354:0:14231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.258365:0:14231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.258388:0:14231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951790.259595:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+9:2359:x1870608602361216:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 572us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951790.259607:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00010000:00010000:2.0:1783951790.259750:0:14877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023b2c47d/0x443dabd358eeda0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b53 expref: 8 pid: 14880 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951790.259776:0:14877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14877:1870608624361984:192.168.201.6@tcp:104: 00010000:00010000:2.0:1783951790.259801:0:14877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259838:0:14877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259846:0:14877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259897:0:14877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259906:0:14877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259914:0:14877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259921:0:14877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951790.259925:0:14877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259934:0:14877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259951:0:14877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.259958:0:14877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951790.260035:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+7:2359:x1870608602361088:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 15853us (18430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951790.260052:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1783951790.263406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951790.267013:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602361472 00000100:00100000:2.0:1783951790.267034:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602361472 00000100:00100000:2.0:1783951790.267189:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1783951790.267203:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+14:14451:x1870608602361472:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783951790.267317:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.267336:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.267347:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.267789:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.267803:0:14245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 15 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.267836:0:14245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.267874:0:14245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 15 pid: 14245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.267888:0:14245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 15 pid: 14245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951790.267916:0:14245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14245:1870608624362112:192.168.201.6@tcp:104: 00000100:00100000:2.0:1783951790.268014:0:14245:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d44d87240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951790.272680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951790.273921:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602361600 00000100:00100000:3.0:1783951790.273937:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602361600 00010000:00010000:3.0:1783951790.273987:0:14230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 16 pid: 14245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951790.274032:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783951790.274041:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d502d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+16:2359:x1870608602361600:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951790.274071:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951790.274078:0:14230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 16 pid: 14245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.274093:0:14230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 16 pid: 14245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.274115:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:3.0:1783951790.274121:0:14230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.274130:0:14230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.274138:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.274158:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951790.274218:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d502d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+16:2359:x1870608602361600:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 178us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951790.274227:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:0.0:1783951790.279046:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ed800/0x443dabd358eed9e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b3e expref: 15 pid: 14245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951790.279074:0:14245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14245:1870608624362112:192.168.201.6@tcp:104: 00010000:00010000:0.0:1783951790.279408:0:14245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.279423:0:14245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.279451:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951790.279740:0:14245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1783951790.280049:0:14245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1783951790.280102:0:14245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1783951790.280204:0:14245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14245:1870608624362240:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783951790.280397:0:14245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951790.280489:0:14245:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951790.284050:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624362240 00000100:00100000:1.0:1783951790.284064:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624362240 00000100:00100000:1.0:1783951790.284191:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951790.284202:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14245:x1870608624362240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783951790.284361:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14245:x1870608624362240:12345-0@lo:1000:mdt00_001.0 Request processed in 161us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951790.284369:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951790.284450:0:14245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14245:1870608624362240:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1783951790.285192:0:14245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1783951790.285284:0:14245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14245:1870608624362368:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783951790.285344:0:14245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951790.296104:0:14245:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951790.300157:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624362368 00000100:00100000:3.0:1783951790.300174:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624362368 00000100:00100000:2.0:1783951790.303931:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951790.303957:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14245:x1870608624362368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783951790.304268:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14245:x1870608624362368:12345-0@lo:1000:mdt00_001.0 Request processed in 321us (18923us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783951790.304276:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951790.304398:0:14245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14245:1870608624362368:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783951790.304448:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304474:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304482:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304489:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325600 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951790.304494:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304527:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304546:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:0.0:1783951790.304550:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951790.304556:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304562:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325600/0x443dabd358eeda20 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304600:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304607:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304613:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304617:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ec000 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951790.304620:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304625:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304633:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951790.304635:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951790.304642:0:14245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed97f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b22 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304667:0:14245:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed97f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b22 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304677:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed97f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b22 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.304754:0:14245:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec800/0x443dabd358eed97f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x736c4e45a038b22 expref: 18 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951790.304806:0:14245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d7593ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14245:1870608624362496:192.168.201.6@tcp:105: 00000100:00100000:0.0:1783951790.305069:0:14245:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e8d659e4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951790.314624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.316270:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602361728 00000100:00100000:1.0:1783951790.316285:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602361728 00000100:00100000:1.0:1783951790.316356:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1783951790.316368:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d605c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+19:14450:x1870608602361728:12345-192.168.201.6@tcp:49:dd.0 00000100:00100000:1.0:1783951790.316686:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d605c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0928eb69-1135-4771-83b7-3a40f8ba7584+19:14450:x1870608602361728:12345-192.168.201.6@tcp:49:dd.0 Request processed in 319us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951790.316695:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:2.0:1783951790.324441:0:14245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d7593ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14245:1870608624362496:192.168.201.6@tcp:105: 00010000:00010000:2.0:1783951790.326790:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.326824:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ec000/0x443dabd358eed978 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334380:0:14245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334407:0:14245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334420:0:14245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334435:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334442:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334449:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334481:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ede00 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951790.334485:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334492:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334504:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951790.334507:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951790.334512:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334517:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d6d5ede00/0x443dabd358eeda27 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334533:0:14245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334539:0:14245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334545:0:14245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334549:0:14245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75325800 already unused, calling callback (ffffffffc214b4f0) 00010000:00010000:0.0:1783951790.334552:0:14245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334557:0:14245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334577:0:14245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8d71d6d000) 00010000:00010000:0.0:1783951790.334579:0:14245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951790.334582:0:14245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.334587:0:14245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d75325800/0x443dabd358eeda19 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951790.334897:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+18:14451:x1870608602361472:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 67690us (71498us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1783951790.334909:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000020:00080000:0.0:1783951790.334915:0:14245:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783951790.337325:0:14279:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783951790.337336:0:14279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951790.337368:0:14279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783951790.337374:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783951790.349082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951790.351100:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602361984 00000100:00100000:2.0:1783951790.351116:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602361984 00000100:00100000:1.0:1783951790.357098:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1783951790.357127:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+18:14451:x1870608602361984:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783951790.358110:0:14248:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783951790.358208:0:14248:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1783951790.358252:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.358269:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.358281:0:14248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.358290:0:14248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.358303:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.358310:0:14248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.358396:0:14248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783951790.358513:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0928eb69-1135-4771-83b7-3a40f8ba7584+20:14451:x1870608602361984:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1397us (9440us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1783951790.358522:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000020:00080000:1.0:1783951790.358939:0:14248:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783951790.359008:0:14232:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951790.359017:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.359036:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28600 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951790.359039:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.359057:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.359070:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8d452ae700) 00010000:00010000:2.0:1783951790.359072:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783951790.359077:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.359083:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8d42e28600/0x443dabd358eeda2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.359094:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951790.359096:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951790.359097:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951790.582034:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951790.622644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.622691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.622725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.622783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951790.622945:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602362112 00000100:00100000:0.0:1783951790.622955:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602362112 00000100:00100000:0.0:1783951790.623006:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602362240 00000100:00100000:0.0:1783951790.623009:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602362240 00000100:00100000:0.0:1783951790.623021:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602362368 00000100:00100000:0.0:1783951790.623023:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602362368 00000100:00100000:0.0:1783951790.623033:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602362496 00000100:00100000:0.0:1783951790.623035:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602362496 00000100:00100000:0.0:1783951790.623051:0:14885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1783951790.623060:0:14885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+10:2359:x1870608602362112:12345-192.168.201.6@tcp:4:dd.0 00002000:00010000:0.0:1783951790.623106:0:14885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a54f1ae, atime: 0x6a54f1ad, ctime: 0x6a54f1ae, blocks: 0x1 00010000:00010000:0.0:1783951790.623115:0:14885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.623132:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1783951790.623151:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951790.623158:0:14885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951790.623174:0:14885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951790.646770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951790.646845:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1783951790.647005:0:14884:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783951790.647015:0:14884:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1783951790.649392:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951790.649430:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602362752 00000100:00100000:0.0:1783951790.649439:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602362752 00000100:00100000:0.0:1783951790.649492:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951790.649497:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602362624 00000100:00100000:0.0:1783951790.649500:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602362624 00000100:00100000:1.0:1783951790.651738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1783951790.651799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951790.653404:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783951790.653421:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602362880 00000100:00100000:3.0:1783951790.653430:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602362880 00000100:00100000:3.0:1783951790.653494:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783951790.653509:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602363008 00000100:00100000:3.0:1783951790.653513:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602363008 00000100:00100000:2.0:1783951790.654398:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1783951790.654413:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+15:2359:x1870608602362240:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:2.0:1783951790.654454:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.654473:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951790.654477:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951790.654483:0:16376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.654497:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951790.781594:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1783951790.781625:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1783951790.781641:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1783951790.784594:0:14885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1783951790.784603:0:14885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1783951790.784618:0:14885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.784633:0:14885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.784643:0:14885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.784667:0:14885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ede00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:1.0:1783951790.784672:0:14885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.784680:0:14885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.784699:0:14885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.784707:0:14885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d7a8c13/0x443dabd358eeda35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951790.784853:0:14885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+15:2359:x1870608602362112:12345-192.168.201.6@tcp:4:dd.0 Request processed in 161750us (162176us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783951790.784879:0:14885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1783951790.784915:0:14885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1783951790.784929:0:14885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+14:2359:x1870608602362368:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:1.0:1783951790.784964:0:14885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.784978:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951790.784984:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951790.784992:0:14885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951790.785018:0:14885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951790.837124:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1783951790.845805:0:16376:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1783951790.845834:0:16376:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1783951790.845851:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.845864:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.845873:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.845881:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:2.0:1783951790.845886:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.845894:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.845914:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.845921:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951790.846009:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+14:2359:x1870608602362240:12345-192.168.201.6@tcp:4:dd.0 Request processed in 191596us (223313us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783951790.846028:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1783951790.846060:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:2.0:1783951790.846070:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7a088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+13:2359:x1870608602362496:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:2.0:1783951790.846100:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.846112:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951790.846116:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951790.846122:0:16376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.846134:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951790.934152:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1783951790.935383:0:14885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00010000:00010000:3.0:1783951790.935582:0:14885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.935598:0:14885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.935607:0:14885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.935615:0:14885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d42e28400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951790.935620:0:14885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.935629:0:14885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.935648:0:14885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951790.935656:0:14885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee5a9451/0x443dabd358eeda43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951790.936146:0:14885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+13:2359:x1870608602362368:12345-192.168.201.6@tcp:4:dd.0 Request processed in 151216us (313413us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1783951790.936173:0:14885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1783951790.948113:0:14885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1783951790.948142:0:14885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d65af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+12:2358:x1870608602362752:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:2.0:1783951790.948192:0:14885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.948211:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951790.948217:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951790.948224:0:14885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951790.948239:0:14885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951791.030473:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1783951791.046538:0:16376:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1783951791.046549:0:16376:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1783951791.046568:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.046582:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.046591:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.046599:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324c00 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951791.046623:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.046632:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.046653:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.046660:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cbd0d39/0x443dabd358eeda4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951791.046770:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7a088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+12:2359:x1870608602362496:12345-192.168.201.6@tcp:4:dd.0 Request processed in 200682us (423966us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783951791.046782:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:0.0:1783951791.046848:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1783951791.046878:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+11:2358:x1870608602362624:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:0.0:1783951791.046912:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.046924:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951791.046928:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951791.046934:0:16376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.046946:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951791.128346:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1783951791.130865:0:14885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1783951791.130890:0:14885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.130904:0:14885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.130914:0:14885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.130921:0:14885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d75324400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951791.130927:0:14885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.130948:0:14885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.130973:0:14885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.130981:0:14885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f602e880/0x443dabd358eeda51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951791.131097:0:14885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d65af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+11:2358:x1870608602362752:12345-192.168.201.6@tcp:4:dd.0 Request processed in 182964us (484350us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1783951791.131125:0:14885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1783951791.131164:0:14885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1783951791.131177:0:14885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+10:2359:x1870608602362880:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:0.0:1783951791.131216:0:14885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.131228:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783951791.131233:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951791.131240:0:14885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.131251:0:14885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951791.184944:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1783951791.185492:0:16376:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:0.0:1783951791.185512:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.185526:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.185534:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.185541:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ec600 already unused, calling callback (ffffffffc171e230) 00010000:00010000:0.0:1783951791.185546:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.185566:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.185586:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.185593:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8248bb/0x443dabd358eeda58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951791.185692:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+10:2358:x1870608602362624:12345-192.168.201.6@tcp:4:dd.0 Request processed in 138830us (538840us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1783951791.185702:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1783951791.185732:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1783951791.185744:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+9:2359:x1870608602363008:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:0.0:1783951791.185788:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.185801:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951791.185806:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951791.185843:0:16376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951791.185855:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951791.223406:0:14885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1783951791.223418:0:14885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1783951791.223434:0:14885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.223461:0:14885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.223470:0:14885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.223478:0:14885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed600 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951791.223482:0:14885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.223491:0:14885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.223509:0:14885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.223517:0:14885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c275de6/0x443dabd358eeda5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951791.223632:0:14885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+11:2359:x1870608602362880:12345-192.168.201.6@tcp:4:dd.0 Request processed in 92453us (571897us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1783951791.223658:0:14885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000001:00080000:0.0:1783951791.224888:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:1.0:1783951791.265846:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1783951791.266695:0:16376:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1783951791.266713:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.266727:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.266736:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.266755:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8d6d5ed400 already unused, calling callback (ffffffffc171e230) 00010000:00010000:3.0:1783951791.266761:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.266772:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.266790:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951791.266799:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dab74427/0x443dabd358eeda66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951791.266940:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2359:x1870608602363008:12345-192.168.201.6@tcp:4:dd.0 Request processed in 81193us (615135us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1783951791.266964:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00010000:00010000:2.0:1783951791.606176:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.631975:0:14233:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951792.927366:0:16416:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1783951793.526082:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951793.526103:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d8121ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624362624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951793.526165:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951793.526498:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951793.526509:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d502d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624362752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951793.526537:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951793.526608:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624362624 00000100:00100000:2.0:1783951793.526617:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624362624 00000100:00100000:2.0:1783951793.526673:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624362752 00000100:00100000:2.0:1783951793.526676:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624362752 00000100:00100000:2.0:1783951793.526691:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783951793.526699:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d8121d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624362624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951793.526757:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783951793.526798:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d8121d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1870608624362624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951793.526805:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783951793.526846:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783951793.526852:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624362752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951793.526869:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1783951793.526893:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870608624362752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951793.526899:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783951793.527007:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951793.527011:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951793.527035:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1783951793.527040:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8d81339c00, transno 8589934595 00000004:00080000:0.0:1783951793.527055:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1783951793.527089:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d502d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1870608624362752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951793.528037:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d8121ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1870608624362624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951793.529027:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624363136:0@lo:400:kworker.0 00000100:00100000:3.0:1783951793.529086:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951793.529115:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951793.529121:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624363008:0@lo:400:kworker.0 00000100:00100000:3.0:1783951793.529141:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951793.529171:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624363136 00000100:00100000:3.0:1783951793.529178:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624363136 00000100:00100000:3.0:1783951793.529223:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624363008 00000100:00100000:3.0:1783951793.529226:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624363008 00000100:00100000:3.0:1783951793.529243:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951793.529252:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624363136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951793.529298:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870608624363136:12345-0@lo:400:kworker.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951793.529306:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951793.529322:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783951793.529328:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624363008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951793.529353:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870608624363008:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951793.529359:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951793.529365:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3315:1870608624362880:0@lo:400:kworker.0 00000100:00080000:3.0:1783951793.529372:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951793.529395:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870608624363008:0@lo:400:kworker.0 00000100:00100000:0.0:1783951793.529398:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951793.529405:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1870608624363136:0@lo:400:kworker.0 00000100:00100000:0.0:1783951793.529425:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951793.529428:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624362880 00000100:00100000:0.0:1783951793.529431:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e8d5855f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624363264:0@lo:400:kworker.0 00000100:00100000:3.0:1783951793.529443:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624362880 00000100:00100000:0.0:1783951793.529452:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951793.529467:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783951793.529471:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608624363264 00000100:00100000:3.0:1783951793.529473:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3315:x1870608624362880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951793.529474:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608624363264 00000100:00100000:0.0:1783951793.529501:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951793.529504:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8+19:3315:x1870608624362880:12345-0@lo:400:kworker.0 Request processed in 32us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951793.529506:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d7593f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624363264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951793.529510:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1783951793.529533:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951793.529533:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d7593f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870608624363264:12345-0@lo:400:kworker.0 Request processed in 27us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951793.529539:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951793.529549:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1870608624363264:0@lo:400:kworker.0 00000100:00100000:3.0:1783951793.529557:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e8d5855ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1dc4d8c-6fbc-417e-98ac-68e48dc3f5c8:3315:1870608624362880:0@lo:400:kworker.0 00010000:00010000:3.0:1783951793.654095:0:14232:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951794.026710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951794.026753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951794.026775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951794.026823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951794.026848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951794.026857:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602363136 00000100:00100000:3.0:1783951794.026866:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1783951794.026869:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602363136 00000100:00100000:3.0:1783951794.026884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1783951794.026909:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602363520 00000100:00100000:3.0:1783951794.026912:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602363520 00000100:00100000:0.0:1783951794.026920:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:3.0:1783951794.026940:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602363776 00000100:00100000:0.0:1783951794.026941:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d79e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:2358:x1870608602363136:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951794.026942:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602363776 00000100:00100000:3.0:1783951794.026954:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602363392 00000100:00100000:3.0:1783951794.026957:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602363392 00000100:00100000:3.0:1783951794.026968:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602363904 00000100:00100000:3.0:1783951794.026971:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602363904 00000100:00100000:3.0:1783951794.026983:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783951794.026999:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2358:x1870608602363520:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1783951794.027030:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d79e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:544b254b-942e-47b4-ac59-b6a7835a5897+13:2358:x1870608602363136:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 90us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951794.027038:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:2.0:1783951794.027150:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602363264 00000100:00100000:2.0:1783951794.027154:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602363264 00000100:00100000:2.0:1783951794.027194:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870608602363648 00000100:00100000:2.0:1783951794.027200:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870608602363648 00000100:00100000:2.0:1783951794.027234:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1783951794.027276:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+20:2358:x1870608602363264:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951794.031139:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2358:x1870608602363520:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 4137us (4372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951794.031160:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1783951794.031204:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1783951794.031221:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26878562-7460-4897-9435-927f340b8f45+5:2358:x1870608602363776:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951794.031299:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26878562-7460-4897-9435-927f340b8f45+5:2358:x1870608602363776:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 87us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951794.031306:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1783951794.031322:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1783951794.031329:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2358:x1870608602363392:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951794.031359:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0928eb69-1135-4771-83b7-3a40f8ba7584+5:2358:x1870608602363392:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 29us (4509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951794.031367:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1783951794.031380:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1783951794.031387:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26878562-7460-4897-9435-927f340b8f45+5:2358:x1870608602363904:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951794.031408:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26878562-7460-4897-9435-927f340b8f45+5:2358:x1870608602363904:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951794.031414:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00080000:3.0:1783951794.031453:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951794.031460:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951794.031462:0:14240:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951794.031477:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1783951794.031484:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8d5855ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26878562-7460-4897-9435-927f340b8f45+6:2358:x1870608602363648:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1783951794.031513:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26878562-7460-4897-9435-927f340b8f45+6:2358:x1870608602363648:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (4646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951794.031527:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:2.0:1783951794.035265:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8d5855ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0928eb69-1135-4771-83b7-3a40f8ba7584+20:2358:x1870608602363264:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 7967us (8596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951794.035287:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000040:00080000:1.0:1783951794.422156:0:14279:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783951794.422166:0:14279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951794.422204:0:14279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783951794.422211:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 29362 lines, 29362 kept, 0 dropped, 0 bad.